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The material presented in this book is as a result of four decades of experience in the 
field of control engineering. During the 1960s, following an engineering apprentice- 
ship in the aircraft industry, I worked as a development engineer on flight control 
systems for high-speed military aircraft. It was during this period that I first observed 
an unstable control system, was shown how to frequency-response test a system and 
its elements, and how to plot a Bode and Nyquist diagram. All calculations were 
undertaken on a slide-rule, which I still have. Also during this period I worked in 
the process industry where I soon discovered that the incorrect tuning for a PID 
controller on a 100 m long drying oven could cause catastrophic results. 

On the 1st September 1970 I entered academia as a lecturer (Grade II) and in that 
first year, as I prepared my lecture notes, I realized just how little I knew about 
control engineering. My professional life from that moment on has been one of 
discovery (currently termed 'life-long learning'). During the 1970s I registered for 
an M.Phil, which resulted in writing a FORTRAN program to solve the matrix 
Riccati equations and to implement the resulting control algorithm in assembler on a 
minicomputer. 

In the early 1980s I completed a Ph.D. research investigation into linear quadratic 
Gaussian control of large ships in confined waters. For the past 17 years I have 
supervised a large number of research and consultancy projects in such areas as 
modelling the dynamic behaviour of moving bodies (including ships, aircraft missiles 
and weapons release systems) and extracting information using state estimation 
techniques from systems with noisy or incomplete data. More recently, research 
projects have focused on the application of artificial intelligence techniques to 
control engineering projects. One of the main reasons for writing this book has been 
to try and capture four decades of experience into one text, in the hope that engineers 
of the future benefit from control system design methods developed by engineers of 
my generation. 

The text of the book is intended to be a comprehensive treatment of control 
engineering for any undergraduate course where this appears as a topic. The book 
is also intended to be a reference source for practising engineers, students under- 
taking Masters degrees, and an introductory text for Ph.D. research students. 
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Introduction to control 
engineering 



1.1 Historical revie\ 

Throughout history mankind has tried to control the world in which he lives. From 
the earliest days he realized that his puny strength was no match for the creatures 
around him. He could only survive by using his wits and cunning. His major asset 
over all other life forms on earth was his superior intelligence. Stone Age man devised 
tools and weapons from flint, stone and bone and discovered that it was possible to 
train other animals to do his bidding - and so the earliest form of control system was 
conceived. Before long the horse and ox were deployed to undertake a variety of 
tasks, including transport. It took a long time before man learned to replace animals 
with machines. 

Fundamental to any control system is the ability to measure the output of the 
system, and to take corrective action if its value deviates from some desired value. 
This in turn necessitates a sensing device. Man has a number of 'in-built' senses 
which from the beginning of time he has used to control his own actions, the actions 
of others, and more recently, the actions of machines. In driving a vehicle for 
example, the most important sense is sight, but hearing and smell can also contribute 
to the driver's actions. 

The first major step in machine design, which in turn heralded the industrial 
revolution, was the development of the steam engine. A problem that faced engineers 
at the time was how to control the speed of rotation of the engine without human 
intervention. Of the various methods attempted, the most successful was the use of 
a conical pendulum, whose angle of inclination was a function (but not a linear 
function) of the angular velocity of the shaft. This principle was employed by James 
Watt in 1769 in his design of a flyball, or centrifugal speed governor. Thus possibly 
the first system for the automatic control of a machine was born. 

The principle of operation of the Watt governor is shown in Figure 1.1, where 
change in shaft speed will result in a different conical angle of the flyballs. This in 
turn results in linear motion of the sleeve which adjusts the steam mass flow-rate to 
the engine by means of a valve. 

Watt was a practical engineer and did not have much time for theoretical analysis. 
He did, however, observe that under certain conditions the engine appeared to hunt, 
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Steam 



Fig. 1.1 TheWatt centrifugal speed governor. 

where the speed output oscillated about its desired value. The elimination of hunting, 
or as it is more commonly known, instability, is an important feature in the design of 
all control systems. 

In his paper 'On Governors', Maxwell (1868) developed the differential equations 
for a governor, linearized about an equilibrium point, and demonstrated that stabil- 
ity of the system depended upon the roots of a characteristic equation having 
negative real parts. The problem of identifying stability criteria for linear systems 
was studied by Hurwitz (1875) and Routh (1905). This was extended to consider the 
stability of nonlinear systems by a Russian mathematician Lyapunov (1893). The 
essential mathematical framework for theoretical analysis was developed by Laplace 
(1749-1827) and Fourier (1758-1830). 

Work on feedback amplifier design at Bell Telephone Laboratories in the 1930s was 
based on the concept of frequency response and backed by the mathematics of complex 
variables. This was discussed by Nyquist (1932) in his paper 'Regeneration Theory', 
which described how to determine system stability using frequency domain methods. 
This was extended by Bode (1945) and Nichols during the next 15 years to give birth to 
what is still one of the most commonly used control system design methodologies. 

Another important approach to control system design was developed by Evans 
(1948). Based on the work of Maxwell and Routh, Evans, in his Root Locus method, 
designed rules and techniques that allowed the roots of the characteristic equation to 
be displayed in a graphical manner. 
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The advent of digital computers in the 1950s gave rise to the state-space formula- 
tion of differential equations, which, using vector matrix notation, lends itself readily 
to machine computation. The idea of optimum design was first mooted by Wiener 
(1949). The method of dynamic programming was developed by Bellman (1957), at 
about the same time as the maximum principle was discussed by Pontryagin (1962). 
At the first conference of the International Federation of Automatic Control 
(IFAC), Kalman (1960) introduced the dual concept of controllability and observ- 
ability. At the same time Kalman demonstrated that when the system dynamic 
equations are linear and the performance criterion is quadratic (LQ control), then 
the mathematical problem has an explicit solution which provides an optimal control 
law. Also Kalman and Bucy (1961) developed the idea of an optimal filter (Kalman 
filter) which, when combined with an optimal controller, produced linear-quadratic- 
Gaussian (LQG) control. 

The 1980s saw great advances in control theory for the robust design of systems 
with uncertainties in their dynamic characteristics. The work of Athans (1971), 
Safanov (1980), Chiang (1988), Grimble (1988) and others demonstrated how uncer- 
tainty can be modelled and the concept of the Hoo norm and //-synthesis theory. 

The 1990s has introduced to the control community the concept of intelligent 
control systems. An intelligent machine according to Rzevski (1995) is one that is 
able to achieve a goal or sustained behaviour under conditions of uncertainty. 
Intelligent control theory owes much of its roots to ideas laid down in the field of 
Artificial Intelligence (AI). Artificial Neural Networks (ANNs) are composed of 
many simple computing elements operating in parallel in an attempt to emulate their 
biological counterparts. The theory is based on work undertaken by Hebb (1949), 
Rosenblatt (1961), Kohonen (1987), Widrow-Hoff (1960) and others. The concept of 
fuzzy logic was introduced by Zadeh (1965). This new logic was developed to allow 
computers to model human vagueness. Fuzzy logic controllers, whilst lacking the 
formal rigorous design methodology of other techniques, offer robust control with- 
out the need to model the dynamic behaviour of the system. Workers in the field 
include Mamdani (1976), Sugeno (1985) Sutton (1991) and Tong (1978). 



1.2 Control system fundamentals 
1.2.1 Concept of a system 



Before discussing the structure of a control system it is necessary to define what is 
meant by a system. Systems mean different things to different people and can include 
purely physical systems such as the machine table of a Computer Numerically 
Controlled (CNC) machine tool or alternatively the procedures necessary for the 
purchase of raw materials together with the control of inventory in a Material 
Requirements Planning (MRP) system. 

However, all systems have certain things in common. They all, for example, 
require inputs and outputs to be specified. In the case of the CNC machine tool 
machine table, the input might be the power to the drive motor, and the outputs 
might be the position, velocity and acceleration of the table. For the MRP system 
inputs would include sales orders and sales forecasts (incorporated in a master 
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Inputs 




Outputs 



Boundary 



Fig. 1.2 The concept of a system. 



production schedule), a bill of materials for component parts and subassemblies, 
inventory records and information relating to capacity requirements planning. Mate- 
rial requirements planning systems generate various output reports that are used in 
planning and managing factory operations. These include order releases, inventory 
status, overdue orders and inventory forecasts. It is necessary to clearly define the 
boundary of a system, together with the inputs and outputs that cross that boundary. 
In general, a system may be defined as a collection of matter, parts, components or 
procedures which are included within some specified boundary as shown in Figure 
1.2. A system may have any number of inputs and outputs. 

In control engineering, the way in which the system outputs respond in changes to 
the system inputs (i.e. the system response) is very important. The control system 
design engineer will attempt to evaluate the system response by determining a 
mathematical model for the system. Knowledge of the system inputs, together with 
the mathematical model, will allow the system outputs to be calculated. 

It is conventional to refer to the system being controlled as the plant, and this, as 
with other elements, is represented by a block diagram. Some inputs, the engineer will 
have direct control over, and can be used to control the plant outputs. These are 
known as control inputs. There are other inputs over which the engineer has no 
control, and these will tend to deflect the plant outputs from their desired values. 
These are called disturbance inputs. 

In the case of the ship shown in Figure 1.3, the rudder and engines are the control 
inputs, whose values can be adjusted to control certain outputs, for example heading 
and forward velocity. The wind, waves and current are disturbance inputs and will 
induce errors in the outputs (called controlled variables) of position, heading and 
forward velocity. In addition, the disturbances will introduce increased ship motion 
(roll, pitch and heave) which again is not desirable. 



Rudder 

Engines 

Wind 

Waves 

Current 



Ship 













Position 

Forward Velocity 
Heading 
Ship Motion 
(roll, pitch, heave) 



Fig. 1.3 A ship as a dynamic system. 
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Control Input 



Controlled Variable 

► or 

Output 

Summing 
Point 

Fig. 1.4 Plant inputs and outputs. 

Generally, the relationship between control input, disturbance input, plant and 
controlled variable is shown in Figure 1.4. 

1.2.2 Open-loop systems 

Figure 1.4 represents an open-loop control system and is used for very simple 
applications. The main problem with open-loop control is that the controlled vari- 
able is sensitive to changes in disturbance inputs. So, for example, if a gas fire is 
switched on in a room, and the temperature climbs to 20 °C, it will remain at that 
value unless there is a disturbance. This could be caused by leaving a door to the 
room open, for example. Or alternatively by a change in outside temperature. In 
either case, the internal room temperature will change. For the room temperature to 
remain constant, a mechanism is required to vary the energy output from the gas fire. 



1.2.3 Closed-loop systems 



For a room temperature control system, the first requirement is to detect or sense 
changes in room temperature. The second requirement is to control or vary the energy 
output from the gas fire, if the sensed room temperature is different from the desired 
room temperature. In general, a system that is designed to control the output of a 
plant must contain at least one sensor and controller as shown in Figure 1.5. 
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Fig. 1.5 Closed-loop control system. 
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Figure 1.5 shows the generalized schematic block-diagram for a closed-loop, or 
feedback control system. The controller and plant lie along the forward path, and the 
sensor in the feedback path. The measured value of the plant output is compared at 
the summing point with the desired value. The difference, or error is fed to the 
controller which generates a control signal to drive the plant until its output equals 
the desired value. Such an arrangement is sometimes called an error-actuated system. 



1.3 Examples of control systems 
1.3.1 Room temperature control system 



The physical realization of a system to control room temperature is shown in Figure 
1.6. Here the output signal from a temperature sensing device such as a thermocouple 
or a resistance thermometer is compared with the desired temperature. Any differ- 
ence or error causes the controller to send a control signal to the gas solenoid valve 
which produces a linear movement of the valve stem, thus adjusting the flow of gas to 
the burner of the gas fire. The desired temperature is usually obtained from manual 
adjustment of a potentiometer. 
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Fig. 1.6 Room temperature control system. 
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Fig. 1.7 Block diagram of room temperature control system. 
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A detailed block diagram is shown in Figure 1.7. The physical values of the signals 
around the control loop are shown in brackets. 

Steady conditions will exist when the actual and desired temperatures are the same, 
and the heat input exactly balances the heat loss through the walls of the building. 

The system can operate in two modes: 

(a) Proportional control. Here the linear movement of the valve stem is proportional to 
the error. This provides a continuous modulation of the heat input to the room 
producing very precise temperature control. This is used for applications where temp- 
erature control, of say better than 1 °C, is required (i.e. hospital operating theatres, 
industrial standards rooms, etc.) where accuracy is more important than cost. 

(b) On-off control. Also called thermostatic or bang-bang control, the gas valve is 
either fully open or fully closed, i.e. the heater is either on or off. This form of 
control produces an oscillation of about 2 or 3 °C of the actual temperature 
about the desired temperature, but is cheap to implement and is used for low-cost 
applications (i.e. domestic heating systems). 

1.3.2 Aircraft elevator control 



In the early days of flight, control surfaces of aircraft were operated by cables 
connected between the control column and the elevators and ailerons. Modern 
high-speed aircraft require power-assisted devices, or servomechanisms to provide 
the large forces necessary to operate the control surfaces. 

Figure 1.8 shows an elevator control system for a high-speed jet. 

Movement of the control column produces a signal from the input angular sensor 
which is compared with the measured elevator angle by the controller which generates 
a control signal proportional to the error. This is fed to an electrohydraulic servovalve 
which generates a spool-valve movement that is proportional to the control signal, 
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Fig. 1.8 Elevator control system for a high-speed jet. 
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Fig. 1.9 Block diagram of elevator control system. 

thus allowing high-pressure fluid to enter the hydraulic cylinder. The pressure differ- 
ence across the piston provides the actuating force to operate the elevator. 

Hydraulic servomechanisms have a good power/weight ratio, and are ideal for 
applications that require large forces to be produced by small and light devices. 

In practice, a 'feel simulator' is attached to the control column to allow the pilot to 
sense the magnitude of the aerodynamic forces acting on the control surfaces, thus 
preventing excess loading of the wings and tail-plane. The block diagram for the 
elevator control system is shown in Figure 1.9. 

1.3.3 Computer Numerically Controlled (CNC) machine tool 

Many systems operate under computer control, and Figure 1.10 shows an example of 
a CNC machine tool control system. 

Information relating to the shape of the work-piece and hence the motion of the 
machine table is stored in a computer program. This is relayed in digital format, in a 
sequential form to the controller and is compared with a digital feedback signal from 
the shaft encoder to generate a digital error signal. This is converted to an analogue 
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Fig. 1.10 Computer numerically controlled machine tool. 
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Fig. 1.11 Block diagram of CNC machine-tool control system. 

control signal which, when amplified, drives a d.c. servomotor. Connected to the 
output shaft of the servomotor (in some cases through a gearbox) is a lead-screw to 
which is attached the machine table, the shaft encoder and a tachogenerator. The 
purpose of this latter device, which produces an analogue signal proportional to 
velocity, is to form an inner, or minor control loop in order to dampen, or stabilize 
the response of the system. 

The block diagram for the CNC machine tool control system is shown in Figure 1.11. 



1.3.4 Ship autopilot control system 



A ship autopilot is designed to maintain a vessel on a set heading while being 
subjected to a series of disturbances such as wind, waves and current as shown in 
Figure 1.3. This method of control is referred to as course-keeping. The autopilot can 
also be used to change course to a new heading, called course-changing. The main 
elements of the autopilot system are shown in Figure 1.12. 

The actual heading is measured by a gyro-compass (or magnetic compass in a 
smaller vessel), and compared with the desired heading, dialled into the autopilot by 
the ship's master. The autopilot, or controller, computes the demanded rudder angle 
and sends a control signal to the steering gear. The actual rudder angle is monitored 
by a rudder angle sensor and compared with the demanded rudder angle, to form a 
control loop not dissimilar to the elevator control system shown in Figure 1.8. 

The rudder provides a control moment on the hull to drive the actual heading 
towards the desired heading while the wind, waves and current produce moments that 
may help or hinder this action. The block diagram of the system is shown in Figure 1.13. 
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Fig. 1.12 Ship autopilot control system. 
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Fig. 1.13 Block diagram of ship autopilot control system. 



1.4 Summary 

In order to design and implement a control system the following essential generic 
elements are required: 

• Knowledge of the desired value: It is necessary to know what it is you are trying to 
control, to what accuracy, and over what range of values. This must be expressed 
in the form of a performance specification. In the physical system this information 
must be converted into a form suitable for the controller to understand (analogue 
or digital signal). 

• Knowledge of the output or actual value: This must be measured by a feedback 
sensor, again in a form suitable for the controller to understand. In addition, the 
sensor must have the necessary resolution and dynamic response so that the 
measured value has the accuracy required from the performance specification. 

• Knowledge of the controlling device: The controller must be able to accept meas- 
urements of desired and actual values and compute a control signal in a suitable 
form to drive an actuating element. Controllers can be a range of devices, including 
mechanical levers, pneumatic elements, analogue or digital circuits or microcomputers. 

• Knowledge of the actuating device: This unit amplifies the control signal and 
provides the 'effort' to move the output of the plant towards its desired value. In 
the case of the room temperature control system the actuator is the gas solenoid valve 
and burner, the 'effort' being heat input (W). For the ship autopilot system the 
actuator is the steering gear and rudder, the 'effort' being turning moment (Nm). 

• Knowledge of the plant: Most control strategies require some knowledge of the 
static and dynamic characteristics of the plant. These can be obtained from 
measurements or from the application of fundamental physical laws, or a com- 
bination of both. 



1.4.1 Control system design 



With all of this knowledge and information available to the control system designer, 
all that is left is to design the system. The first problem to be encountered is that the 
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Fig. 1.14 Steps in the design of a control system. 
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knowledge of the system will be uncertain and incomplete. In particular, the dynamic 
characteristics of the system may change with time (time-variant) and so a fixed 
control strategy will not work. Due to fuel consumption for example, the mass of an 
airliner can be almost half that of its take-off value at the end of a long haul flight. 

Measurements of the controlled variables will be contaminated with electrical 
noise and disturbance effects. Some sensors will provide accurate and reliable data, 
others, because of difficulties in measuring the output variable may produce highly 
random and almost irrelevant information. 

However, there is a standard methodology that can be applied to the design of 
most control systems. The steps in this methodology are shown in Figure 1.14. 

The design of a control system is a mixture of technique and experience. This book 
explains some tried and tested, and some more recent approaches, techniques and 
methods available to the control system designer. Experience, however, only comes 
with time. 
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System modelling 



2.1 Mathematical models 

If the dynamic behaviour of a physical system can be represented by an equation, or 
a set of equations, this is referred to as the mathematical model of the system. Such 
models can be constructed from knowledge of the physical characteristics of the 
system, i.e. mass for a mechanical system or resistance for an electrical system. 
Alternatively, a mathematical model may be determined by experimentation, by 
measuring how the system output responds to known inputs. 



2.2 Simple mathematical model of a motor vehicle 

Assume that a mathematical model for a motor vehicle is required, relating the accel- 
erator pedal angle 6 to the forward speed u, a simple mathematical model might be 

u{t) = a0(t) (2.1) 

Since u and are functions of time, they are written u(t) and 6(f). The constant a 
could be calculated if the following vehicle data for engine torque T, wheel traction 
force F, aerodynamic drag D were available 

T = b0{t) (2.2) 

F = cT (2.3) 

D = du(t) (2.4) 

Now aerodynamic drag D must equal traction force F 

D = F 

du(t) = cT 
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Accelerator angle 6(t) (degrees) 
Fig. 2.1 Vehicle forward speed plotted against accelerator angle. 



from (2.2) 



giving 



du(t) = cb0(t) 



u(t) 



Hence the constant for the vehicle is 



cb 



0(t) 



(2.5) 



(2.6) 



If the constants b, c and d were not available, then the vehicle model could be 
obtained by measuring the forward speed u(f) for a number of different accelerator 
angles 0(t) and plotting the results, as shown in Figure 2.1. 

Since Figure 2.1 shows a linear relationship, the value of the vehicle constant a is 
the slope of the line. 



2.3 More complex mathematical models 

Equation (2.1) for the motor vehicle implies that when there is a change in accelerator 
angle, there is an instantaneous change in vehicle forward speed. As all car drivers 
know, it takes time to build up to the new forward speed, so to model the dynamic 
characteristics of the vehicle accurately, this needs to be taken into account. 

Mathematical models that represent the dynamic behaviour of physical systems 
are constructed using differential equations. A more accurate representation of the 
motor vehicle would be 



du 

e Ji +fu 



gO(t) 



(2.7) 



Here, du/dt is the acceleration of the vehicle. When it travels at constant velocity, this 
term becomes zero. So then 
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Hence (g/f) is again the vehicle constant, or parameter a in equation (2.1) 

2.3.1 Differential equations with constant coefficients 



In general, consider a system whose output is x(t), whose input is y(i) and contains 
constant coefficients of values a, b, c, . . . , z. If the dynamics of the system produce a 
first-order differential equation, it would be represented as 

dx 
a— + bx = cy(t) (2.9) 

d^ 

If the system dynamics produced a second-order differential equation, it would be 
represented by 

d x dx 
a—^ + b— + ex = ey(t) (2.10) 

at 1 at 

If the dynamics produce a third-order differential equation, its representation 
would be 

d 3 x , d 2 x dx r . . ^ 11N 

a -rr + b -r^ + c -r + ex =fy(t) (2.ll) 

d^ 3 dt 2 dt 

Equations (2.9), (2.10) and (2. II) are linear differential equations with constant 
coefficients. Note that the order of the differential equation is the order of the highest 
derivative. Systems described by such equations are called linear systems of the same 
order as the differential equation. For example, equation (2.9) describes a first-order 
linear system, equation (2.10) a second-order linear system and equation (2. II) a 
third-order linear system. 



2.4 Mathematical models of mechanical systems 

Mechanical systems are usually considered to comprise of the linear lumped para- 
meter elements of stiffness, damping and mass. 

2.4.1 Stiffness in mechanical systems 

An elastic element is assumed to produce an extension proportional to the force (or 
torque) applied to it. 

For the translational spring 

Force oc Extension 
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(a) Translational Spring 
Fig. 2.2 Linear elastic elements. 
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And for the rotational spring 
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(b) Rotational Spring 



P(t) = K( Xi (t) - jc o (0) 



Torque oc Twist 



T(t) = KMt) ~ flo(0) 



(2.12) 



(2.13) 



Note that AT, the spring stiffness, has units of (N/m) in equation (2.12) and (Nm/rad) 
in equation (2.13). 



2.4.2 Damping in mechanical systems 



A damping element (sometimes called a dashpot) is assumed to produce a velocity 
proportional to the force (or torque) applied to it. 
For the translational damper 



Force oc Velocity 
y dx 



P(t) = Cv(t) = C 



At 



And for the rotational damper 

Torque ex Angular velocity 
,d# 



T(t) = Cuo(t) = C 



dt 



(2.14) 



(2.15) 
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Fig. 2.3 Linear damping elements. 
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Note that C, the damping coefficient, has units of (Ns/m) in equation (2.14) and 
(Nms/rad) in equation (2.15). 



2.4.3 Mass in mechanical systems 



The force to accelerate a body is the product of its mass and acceleration (Newton's 
second law). 

For the translational system 



Force ex Acceleration 



_ , x , x dv dx 

Pit) = rna(t) = m— = m - = 
dt dt 2 



(2.16) 



For the rotational system 



Torque oc Angular acceleration 



r dco (J . 



d z n 



T(t) = Mt) = i^ = i- dt2 



(2.17) 



In equation (2.17) / is the moment of inertia about the rotational axis. 

When analysing mechanical systems, it is usual to identify all external forces by 
the use of a 'Free-body diagram', and then apply Newton's second law of motion in 
the form: 



or 



\~^ F = ma for translational systems 
Y^ M = la for rotational systems 



(2.18) 



Example 2.1 

Find the differential equation relating the displacements X[(t) and x (t) for the 
spring-mass-damper system shown in Figure 2.5. What would be the effect of 
neglecting the mass? 
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(a) Translational Acceleration 
Fig. 2.4 Linear mass elements. 
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Fig. 2.5 Spring-mass-damper system. 
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Fig. 2.6 Free-body diagram for spring-mass-damper system. 

Solution 

Using equations (2.12) and (2.14) the free-body diagram is shown in Figure 2.6. 

From equation (2.18), the equation of motion is 



£'* 



ma x 



dx d x 

KiXl - Xo) -C— = m^ r 



Kx[ — Kx = m 

Putting in the form of equation (2.10) 

d 2 x ^ dx 



d x dx 
dfi ^ dt 



m 



d(2 ,c^ + KXo = KxM 



Hence a spring-mass-damper system is a second-order system. 
If the mass is zero then 



5> = o 



K( Xi -x o )-C^- = 
Kx\ — Kx = C 



dx 
dt 



Hence 



C^r- + Kx =Kxi(t) 

at 



(2.19) 



(2.20) 



Thus if the mass is neglected, the system becomes a first-order system. 
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Fig. 2.7 Flywheel in bearings. 



Example 2.2 

A flywheel of moment of inertia / sits in bearings that produce a frictional moment of 
C times the angular velocity uj(f) of the shaft as shown in Figure 2.7. Find the 
differential equation relating the applied torque T(t) and the angular velocity cu(t). 



Solution 

From equation (2.18), the equation of motion is 

^M = Ia 

duj 



T(t) -Cuj = I 



At 



duo 
I—+CLO=T(t) 
At 



(2.21) 



Example 2.3 

Figure 2.8 shows a reduction gearbox being driven by a motor that develops a torque 
T m (t). It has a gear reduction ratio of V and the moments of inertia on the motor 
and output shafts are I m and I , and the respective damping coefficients C m and C . 
Find the differential equation relating the motor torque T m (t) and the output angular 
position 8 (t). 
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Fig. 2.8 Reduction gearbox. 
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Fig. 2.9 Free-body diagrams for reduction gearbox. 

Gearbox parameters 

7 m = 5 x l(T 6 kgm 2 

I = 0.01kgm 2 

C m = 60x l(T 6 Nms/rad 

C = 0.15Nms/rad 

^ = 50:1 

Solution 

The free-body diagrams for the motor shaft and output shaft are shown in Figure 2.9. 
Equations of Motion are 

(1) Motor shaft 



X> = 7 » 



d 2 e m 



T m (t)-C m d ^-aX(t) = I m ^ 



re-arranging the above equation, 



1 



d 2 0„ 



X(t) = -[T m (t)-I mdfi 



C, 



' dt 



(2) Output shaft 



£m = / 



d z e m 

dt 2 



(2.22) 



awa r d0 ° r d9 ° 
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re-arranging the above equation, 



m = Ulo^ + C d 4) (2-23) 



b V ° dfi ' ° dt 
Equating equations (2.22) and (2.23) 



a { mW m dr 2 m dr ) ~ \ ° dr 2 + ° d? 



Kinematic relationships 



a 


= ft m (f) = n0 o (t) 




de m _^do 

dt dt 



d 2 m = d% 
dt 2 " dt 2 

Hence 

(t .a r d ^° r d M (t Al °°^r dd ° 
n[T m {t)-nI m ^-nC m —} = [l — +C — 

giving the differential equation 

(7 + n 2 I m ) ^ + (C + n 2 C m ) ^ = nT m (t) (2.24) 

The terms (I + ft 2 / m ) and (C + n 2 C m ) are called the equivalent moment of inertia I Q 
and equivalent damping coefficient C e referred to the output shaft. 
Substituting values gives 

h = (0.01 + 50 2 x 5 x 1(T 6 ) = 0.0225 kgm 2 
C e = (0.15 + 50 2 x 60 x 10~ 6 ) = 0.3Nms/rad 

From equation (2.24) 

d 2 /9 d/9 

0.0225 — £ + 0.3 — - = 50r m (0 (2.25) 

dt 1 dt 



2.5 Mathematical models of electrical systems 

The basic passive elements of electrical systems are resistance, inductance and capa- 
citance as shown in Figure 2.10. 
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v,(f) 


R 


m 









— MO 

(a) Resistance 



M9 



^innroTRroTrff^mnnro^^ 



v 2 (t) 



v,(0 



— ► '(0 

(b) Inductance 
I I C 



-> to 



J^) 



(c) Capacitance 
Fig. 2.10 Passive elements of anelectrical system. 

For a resistive element, Ohm's Law can be written 

(Vl(0 " V2(0) = W) 

For an inductive element, the relationship between voltage and current is 

di 



(vi(0-v 2 (0) 



At 



(2.26) 



(2.27) 



For a capacitive element, the electrostatic equation is 

Q(t) = C(vi(/) - v 2 (/)) 
Differentiating both sides with respect to £ 

d(2 , x ^ d , , x 

^ = ^(0 = c-(v 1 (0-v 2 (0) 

Note that if both sides of equation (2.28) are integrated then 

1 



Oi(0-v 2 (0) 



C 



/ 



idt 



(2.28) 



(2.29) 



Example 2.4 

Find the differential equation relating v\(t) and v 2 (0 for the RC network shown in 

Figure 2.11. 



Solution 

From equations (2.26) and (2.29) 

vi(0 - v 2 (t) = Ri(t) 



v 2 (0 



-hi 



idt 



(2.30) 
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v,(t} 









i(t) \ c = 

• 1 i 


1 • 



r 



v 2 (t) 



Fig. 2.11 RC network. 



or 



substituting (2.31) into (2.30) 






vi (0 - v 2 (t) = RC 



dV2 

~d7 



Equation (2.32) can be expressed as a first-order differential equation 

RC^+v 2 = v l (t) 
at 



(2.31) 



(2.32) 



(2.33) 



Example 2.5 

Find the differential equations relating v\(t) and v 2 (t) for the networks shown in 

Figure 2.12. 



v,(t) 





R 




L 












* 






< 


* 


• 




/(f) 


i • 



(a) 



MO 



',(0 + 4(0 



MO 



«i 



ft, 



~ 










* 




i 
1 


i i ■ 




/,(0 

1 




" 3 (0 4(0 Ci = 















MO 



(b) 



Fig. 2.12 Electrical networks. 
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Solution for Network (a) Figure 2.12 
From equations (2.26), (2.27) and (2.29) 



v l (t)-v 2 (t) = Ri(t) + L-^ 
v 2 (0 = — / idt 



C 

or 



At 
substituting (2.35) into (2.34) 



^-^ = «ct+4,( c W 



or 



(2.34) 



dv? 
C-r l = i(t) (2.35) 



dv? d v? 

v l (t)-v 2 (t) = RC-^ + LC-^ (2.36) 

Equation (2.36) can be expressed as a second-order differential equation 

d v? dv? 

LC-^ + RC-^ + v 2 = v l (t) (2.37) 

Solution for Network (b) Figure 2.12 
System equations 

vi(0-V3(0 = *i('i(0 + '2(0) (2-38) 

v 3 (0 = <T-/»idf or Ci^ = i,(0 (2.39) 

v 3 (0 - v 2 (0 = R 2 i 2 (t) (2.40) 

v 2 (t) = -^-J i 2 dt or c 2 ^ = i 2 (0 (2.41) 

From equation (2.40) 

v 3 (0 = R 2 i 2 (t) + v 2 (t) 
Substituting for i 2 (t) using equation (2.41) 

vi(t) = R 2 C 2 ^+v 2 (t) (2.42) 
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Hence from equations (2.42) and (2.39) 

d 



/',(/) = C 1 -|i? 2 C 2 ^+v 2 (0 

r r r d2v2 4. r dv2 
R 2 C l C 2l - r +C l — 
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Substituting equations (2.41), (2.42) and (2.43) into equation (2.38) 
vi (0 - | J R 2 C 2 ^+ v 2 (0J = *i{* 






which produces the second-order differential equation 
RiR 2 CiC 2 



^ + (7? 1 C 1 +^ 1 C 2 + 7? 2 C 2 )-^ + v 2 = v 1 (0 



(2.43) 



(2.44) 






2.6 Mathematical models of thermal systems 



It is convenient to consider thermal systems as being analogous to electrical systems 
so that they contain both resistive and capacitive elements. 

2.6.1 Thermal resistance /? T 

Heat flow by conduction is given by Fourier's Law 

KAQBi - 2 ) 



The parameters in equation (2.45) are shown in Figure 2.13. They are 
(0\ — 6 2 ) = Temperature differential (K) 

A = Normal cross sectional area (m 2 ) 
£ = Thickness (m) 
K = Thermal conductivity (W/mK) 
2t = Heat flow (J/s = W) 




(2.45) 



Fig. 2.13 Heat flow through a flat plate. 
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Equation (2.45) can be written in the same form as Ohm's Law (equation (2.26)) 

(0i(O-02(O) = *t6t(O (2.46) 

where R T is the thermal resistance and is 

^t = — A (2.47) 



KA 



2.6.2 Thermal capacitance C T 



The heat stored by a body is 

H(t) = mC p 0(t) (2.48) 

where 

H = Heat (J) 

m = Mass (kg) 

C p = Specific heat at constant 
pressure (J/kgK) 
= Temperature rise (K) 

If equation (2.48) is compared with the electrostatic equation 

Q(t) = Cv(t) (2.49) 

then the thermal capacitance Cj is 

C T = mC v (2.50) 

To obtain the heat flow Qj, equation (2.48) is differentiated with respect to time 



AH „ d6 

— — = mC v — 
dt p dt 



mC p — (2.51) 



or 



d/9 
Qr(t) = C T - (2.52) 

Example 2.6 

Heat flows from a heat source at temperature 6\{i) through a wall having ideal 

thermal resistance R T to a heat sink at temperature 2 (t) having ideal thermal 

capacitance C T as shown in Figure 2.14. Find the differential equation relating 

0i(Oand0 2 (O. 

Solution 

(1) Wall: From equation (2.46) 

M0 _<m=m (2 , 3) 
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Wall 



Heat 
Source 



Fig. 2.14 Heat transfer system. 

(2) Heat sink: From equation (2.52) 




■ 2 (t) 



2t(0 = C t ^ 

Equating equations (2.53) and (2.54) 

(gi(Q - 0i(t)) _ d^ 
i? T ~ d? 

Re-arranging to give the first-order differential equation 

at 



(2.54) 



(2.55) 



2.7 Mathematical models of fluid systems 

Like thermal systems, it is convenient to consider fluid systems as being analogous to 
electrical systems. There is one important difference however, and this is that the 
relationship between pressure and flow-rate for a liquid under turbulent flow condi- 
tions is nonlinear. In order to represent such systems using linear differential equa- 
tions it becomes necessary to linearize the system equations. 



2.7.1 



Linearization of nonlinear functions for small 
perturbations 



Consider a nonlinear function Y =f(x) as shown in Figure 2.15. Assume that it is 
necessary to operate in the vicinity of point a on the curve (the operating point) 
whose co-ordinates are X a ,Y a . 

For the small perturbations AX and A Y about the operating point a let 



AX 
A7 



: X 

y 



(2.56) 
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If the slope at the operating point is 

dX 

then the approximate linear relationship becomes 

AY 



y 



AX 



(2.57) 



Example 2.7 

The free-body diagram of a ship is shown in Figure 2.16. It has a mass of 15 x 10 6 kg 
and the propeller produces a thrust of K n times the angular velocity n of the propeller, 
K n having a value of 110 x 10 3 Ns/rad. The hydrodynamic resistance is given by the 
relationship R = C V F 2 , where C v has a value of 10,000 Ns 2 /m 2 . Determine, using 
small perturbation theory, the linear differential equation relating the forward speed 
v(t) and propeller angular velocity n(t) when the forward speed is 7.5 m/s. 

Solution 

Linearize hydrodynamic resistance equation for an operating speed V a of 7.5 m/s. 

R = C V V 2 

dR 

dV 
dR 



dV 

dR 

dV 



2C Y V 

= 2C v V a 

= 2x 10000x7.5 

= C= 150 000Ns/m 




Y=f(x) 

Approximate linear 
relationship 



X a 



X 



Fig. 2.15 Linearization of a nonlinear function. 
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R=Q,v 



T=K,n 



Fig. 2.16 Free-body diagram of ship. 

Hence the linear relationship is 

R = Cv 
Using Newton's second law of motion 

V^ F x = ma x 

T - R=m— 

dt 

dv 

K n n — Cv = m — 

at 

dv , n ^ 
m — +Cv = K n n 



dt 



Substituting values gives 



dv 



(15 x 10 6 )-- + (150x 10 3 )v = (110x 10 3 )»(0 



(2.58) 



(2.59) 



(2.60) 



Example 2.8 

In Figure 2.17 the tank of water has a cross-sectional area A, and under steady 

conditions both the outflow and inflow is V a and the head is H a . 

(a) Under these conditions find an expression for the linearized valve resistance R$ 
given that flow through the valve is 



V = A v C d ^/2gH, 



where 

V = volumetric flow-rate (m 3 /s) 
A Y = valve flow area (m 2 ) 
Cd = coefficient of discharge 
g = acceleration due to gravity (m/s 2 ) 
H = head across the valve (m) 
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(b) If the steady value of the head H a is 1.5 m, what is the valve resistance Rf when 

A Y = 15 x l(T 3 m 2 

g = 9.81m/s 2 
Q = 0.6 

(c) If the inflow now increases an amount vi producing an increase in head h and an 
increase in outflow v 2 , find the differential equation relating vi and v 2 when the 
tank cross-sectional area A is 0.75 m 2 . 

Solution 

(a) Flow through the valve is given by 



V = A Y C dV ^2gH 



now 



dV_ 

Ih 

dV_ 

Ih 

The linearized relationship is 
hence 



A v C d (2g) 1 / 2 x 0.5H; 1 / 2 




2H a h 



h = RfV2 



Rf 



1 2H a 



AQ V g 



(2.61) 



v a +v, 



'/|\ N 



X 



\Z7\ 



//\\\ 



V +v 



Fig. 2.17 Tank and valve system. 
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(b) Inserting values gives 



1 2 x 1.5 

f ~ 15 x 10- 3 x0.6V 9.81 
R f = 61.45 s/m 2 (2.62) 



(c) Tank (Continuity Equation) 



Inflow — Outflow = A — 
dt 



dt 
dh 
dt 



v l -v 2 =A^ (2.63) 



Valve (Linearized Equation) 



and 



dt dt 

Substituting equation (2.64) into equation (2.63) 

AD dV2 

vi - v 2 = ARf — 



h = Rf V2 



dh n dv2 

R { — - (2.64) 



giving 



Inserting values gives 



AR f ^ + v 2 = vi(t) (2.65) 



46.09^+ v 2 = vi (0 (2.66) 

dt 



2.8 Further problems 



Example 2.9 

A solenoid valve is shown in Figure 2.18. The coil has an electrical resistance of 4 Q, 
an inductance of 0.6 H and produces an electromagnetic force F c (f) of K c times the 
current i(t). The valve has a mass of 0.125 kg and the linear bearings produce 
a resistive force of C times the velocity u(t). The values of K c and C are 0.4 N/A 
and 0.25 Ns/m respectively. Develop the differential equations relating the voltage 
v(t) and current i{t) for the electrical circuit, and also for the current i(f) and velocity 
u(t) for the mechanical elements. Hence deduce the overall differential equation 
relating the input voltage v(t) to the output velocity u(t). 
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u(t) 



R,L,K r 



. H 


Q 


n 


n 


n 


n 


n 


n 


^ 


* H 




u 

















M 




^ ^A 


C 




i(t) 




■ ^ 4 



F c (t) 



v(f) 



Fig. 2.18 Solenoid valve. 
Solution 



di 

L-+Ri=v{t) 

du 
rn — +Cu = K c i(t) 
at 

d ia dt/ 

0.075 -— + 0.65 — + u = 0.4v(f) 
d^ 2 d/ 1 



Example 2.10 

The laser-guided missile shown in Figure 2.19 has a pitch moment of inertia of 
90kgm 2 . The control fins produce a moment about the pitch mass centre of 
360 Nm per radian of fin angle j3{t). The fin positional control system is described 
by the differential equation 

d/3 



0.2 



At 



(3(t) = u(t) 



where u(t) is the control signal. Determine the differential equation relating the 
control signal u(t) and the pitch angle 0(t). 



Solution 



d 3 



5^ = 20,(0 




Fig. 2.19 Laser-guided missile. 
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m 



n 



'o(0 



U 

c 



Fig. 2.20 Torsional spring -mass-damper system. 



Example 2.11 

A torsional spring of stiffness K, a mass of moment of inertia / and a fluid damper 
with damping coefficient C are connected together as shown in Figure 2.20. If the 
angular displacement of the free end of the spring is 6{{t) and the angular displace- 
ment of the mass and damper is o (t), find the differential equation relating 9{(t) and 
O (0 given that 

7 = 2.5kgm 2 
C= 12.5Nms/rad 
^ = 250Nm/rad 

Solution 



2.5 



d 2 o 
dt 2 



12.5 



d0o 
dt 



250(9 o = 250ft(0 



Example 2.12 

A field controlled d.c. motor develops a torque T m (t) proportional to the field current 
if(t). The rotating parts have a moment of inertia / of 1.5 kg m 2 and a viscous 
damping coefficient C of 0.5 Nm s/rad. 

When a current of 1.0 A is passed through the field coil, the shaft finally settles 
down to a steady speed u (t) of 5rad/s. 

(a) Determine the differential equations relating k(t) and cu (t). 

(b) What is the value of the coil constant K c , and hence what is the torque developed 
by the motor when a current of 0.5 A flows through the field coil? 

Solution 

(a) I^- + Cu =Kck(t) 



(b) K c = 2.5Nm/A. T m = 1.25 Nm 
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v,(t) 



"1 



TTi 



v 2 (f) 



Fig. 2.21 Passive RC network. 



vM 



Fig. 2.22 Drying oven. 



Burner 



Oven 



QM 

— ► 



o (t) 



c T 



*T 



's(0 



Example 2.13 

Figure 2.21 shows a passive electrical network. Determine the differential equation 

relating v\(i) and v 2 (t). 



Solution 



RiC 



dv 2 (R\ + Ri 



dt 



Ri 



v 2 = vi(0 



Example 2.14 

A drying oven which is constructed of firebrick walls is heated by an electrically 

operated gas burner as shown in Figure 2.22. The system variables and constants are 

v\(t) = burner operating voltage (V) 
2i(0 = heat input to oven (W) 
O (0 = internal oven temperature (K) 
8 s (t) = temperature of surroundings (K) 
K = burner constant = 2000 W/V 

Rj = thermal resistance of walls = 0.5 x 10 -3 min K/J 

C T = oven thermal capacitance = 1 x 10 4 J/K 

Find the differential equation relating V[(t), o (f) and s (t). 



Solution 



.d0 o 



Vl(O + 0s(O 
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3.1 Introduction 

The manner in which a dynamic system responds to an input, expressed as a function 
of time, is called the time response. The theoretical evaluation of this response is said 
to be undertaken in the time domain, and is referred to as time domain analysis. It is 
possible to compute the time response of a system if the following is known: 

• the nature of the input(s), expressed as a function of time 

• the mathematical model of the system. 

The time response of any system has two components: 

(a) Transient response. This component of the response will (for a stable system) 
decay, usually exponentially, to zero as time increases. It is a function only of the 
system dynamics, and is independent of the input quantity. 

(b) Steady-state response: This is the response of the system after the transient 
component has decayed and is a function of both the system dynamics and the 
input quantity. 




Fig. 3.1 Transient and steady-state periods of time response. 
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The total response of the system is always the sum of the transient and steady-state 
components. Figure 3.1 shows the transient and steady-state periods of time 
response. Differences between the input function X[(t) (in this case a ramp function) 
and system response x (t) are called transient errors during the transient period, and 
steady-state errors during the steady-state period. One of the major objectives of 
control system design is to minimize these errors. 



3.2 Laplace transforms 



In order to compute the time response of a dynamic system, it is necessary to solve 
the differential equations (system mathematical model) for given inputs. There are 
a number of analytical and numerical techniques available to do this, but the one 
favoured by control engineers is the use of the Laplace transform. 

This technique transforms the problem from the time (or t) domain to the Laplace 
(or s) domain. The advantage in doing this is that complex time domain differential 
equations become relatively simple s domain algebraic equations. When a suitable 
solution is arrived at, it is inverse transformed back to the time domain. The process 
is shown in Figure 3.2. 

The Laplace transform of a function of time/(0 is given by the integral 



&\f(t)] 



/•OO 

/ /(/)e-"d/ = F(s) 
Jo 



(3.1) 



where s is a complex variable a ± jo; and is called the Laplace operator. 



Laplace 
Transform 







1 


s Domain F(s) 
► Algebraic 
equations 
















^ 














r 


S[t(t)] = F(s) 


Inverse 
Laplace 
Transform 


2-\F(s)] = f(t) 


A 


L 
















Time Domain f(t) 












Differential 
equations 











Fig. 3.2 The Laplace transform process. 
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3.2.1 Laplace transforms of common functions 

Example 3.1 

f{t) = 1 (called a unit step function). 

Solution 

From equation (3.1) 

yoo 

nf(t)] = F(s) = / le-*'d? 



-(e"*) 



Jo 



-(0-1) 

S 



Example 3.2 



f(t) = e""' 

&[f(t)] = F(s)= / Q~ at Q~ st dt 
Jo 

= / e -< J+fl) 'd* 

Jo 



1 



s + a 

1 

s + a 



( e -(j+fl)f) 
(0-1) 



Jo 



£ + <2 
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(3.2) 



(3.3) 



Table 3.1 gives further Laplace transforms of common functions (called Laplace 
transform pairs). 

3.2.2 Properties of the Laplace transform 



(a) Derivatives: The Laplace transform of a time derivative is 

d n 



dt n 



■fit) = s n F(s) -/(ok- 1 -f(oy- 2 - 



(3.4) 



where /(0),/ r (0) are the initial conditions, or the values of f(t), d/dtf(t) etc. at t = 
(b) Linearity 



&[f x (i)±f 2 (i)} = F x (s)±F 2 (s) 



(3.5) 
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Table 3.1 Common Laplace transform pairs 



Time function f(t) 






Laplace 


transform ^[f(t)] = 


= F(s) 


1 


unit impulse 


6(t) 






1 




2 


unit step 1 








i/s 




3 


unit ramp t 








Us 2 




4 


f 








n\ 




5 


Q -at 








1 




(s + a) 




6 


1 - Q~ at 








a 




s(s + a) 




7 


sinojt 








UJ 




S 2 +UJ 2 




8 


COSLJt 








s 




S 2 +UJ 2 




9 


Q~ at sinut 








uj 




(s + a) 2 + uj 2 




10 


Q~ at (C0SUUt — 


a ■ 

— sin ujt) 

UJ 




s 




(s + a) 2 + uj 2 





(c) Constant multiplication 

&[af(t)] = aF(s) (3.6) 

(d) Real shift theorem 

^[f(t-T)] = Q~ Ts F(s) for T>0 (3.7) 

(e) Convolution integral 



Jo 



f\(Dh(t - r)dr = F l (s)F 2 (s) (3.8) 

Jo 

(f) Initial value theorem 



(g) Final value theorem 



/(0) = lim [/(/)] =lim[*F(*)] (3.9) 

t^O s—>oc 



/(oo) = lim [/(/)] = Km [sF(s)] (3.10) 

t—>oc s^O 



3.2.3 Inverse transformation 



The inverse transform of a function of s is given by the integral 



1 p<T+}U 

f(t) = &- l [F(s)] = — J F(s)c s 'ds (3.11) 



a— ]uj 
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In practice, inverse transformation is most easily achieved by using partial fractions 
to break down solutions into standard components, and then use tables of Laplace 
transform pairs, as given in Table 3.1. 

3.2.4 Common partial fraction expansions 



(i) Factored roots 

K A B 



s(s + a) s (s + a) 
(ii) Repeated roots 

K ABC 



s 2 (s + a) s s 2 (s + a) 

(iii) Second-order real roots (b 2 > 4ac) 

K K A B C 



(3.12) 



(3.13) 



s(as 2 + bs + c) s(s + d)(s + e) s (s + d) (s + e) 

(iv) Second-order complex roots (Z? 2 < Aac) 

K A Bs + C 

s(as 2 + bs + c) s as 2 + bs + c 

Completing the square gives 

A Bs + C 

s (s + a) 2 + u; 2 

Note: In (iii) and (iv) the coefficient a is usually factored to a unity value. 



(3.14) 



3.3 Transfer functions 

A transfer function is the Laplace transform of a differential equation with zero 
initial conditions. It is a very easy way to transform from the time to the s domain, 
and a powerful tool for the control engineer. 

Example 3.3 

Find the Laplace transform of the following differential equation given: 

(a) initial conditions x = 4, dx /d^ = 3 

(b) zero initial conditions 

d 2 x Q dx 
~rr- + 3 — — + 2x = 5 
dt 2 dt 
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Fig. 3.3 The transfer function approach. 

Solution 

(a) Including initial conditions: Take Laplace transforms (equation (3.4), Table 3.1). 

(s 2 X (s) - As - 3) + 3(sX (s) - 4) + 2X (s) = - 



s 2 X (s) + 3sX (s) + 2X (s) = - + 4s + 3 + 12 



(* 2 + 3^ + 2)1^) 



5 + 4s 2 + 15s 



*o0) 



4^ 2 + 15^ + 5 

' s(s 2 + 3s + 2) 



(3.15) 



(b) Zero initial conditions 
At t = 0, x = 0, <±x /ck = 0. 
Take Laplace transforms 



^X (^) + 3^X (^) + 2X (^) 

*o0) 



: ^5 — -, — ~ ( 3 - 16 ) 

s(s 2 + 3s + 2) v y 

Example 3.3(b) is easily solved using transfer functions. Figure 3.3 shows the general 
approach. In Figure 3.3 

• X[(s) is the Laplace transform of the input function. 

• X (s) is the Laplace transform of the output function, or system response. 

• G(s) is the transfer function, i.e. the Laplace transform of the differential equation 
for zero initial conditions. 



The solution is therefore given by 

X (s) = G(s)X l (s) 
Thus, for a general second-order transfer function 

a — — r + b — — h cx = Kxiif) 
at 1 at 

(as 2 +bs + c)X (s) = KXi(s) 



(3.17) 



Hence 



X (s) 



K 



as 2 + bs + c 



X { (s) 



(3.18) 
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m 



K 



as +bs+c 



X Q (s) 



Fig. 3.4 General second-order transfer function. 



X-Xs)=5/s 



s+3s+2 



*o(s) 



Fig. 3.5 Example 3.3(b) expressed as a transfer function. 

Comparing equations (3.17) and (3.18), the transfer function G(s) is 

G(s)= K 



2 + bs + c 



as- 



(3.19) 



which, using the form shown in Figure 3.3, can be expressed as shown in Figure 3.4. 
Returning to Example 3.3(b), the solution, using the transfer function approach is 
shown in Figure 3.5. From Figure 3.5 

*o(s) = , ? , \ , rr (3.20) 



s(s 2 + 3s + 2) 



which is the same as equation (3.16). 



.4 Common time domain input functions 
3.4.1 The impulse function 



An impulse is a pulse with a width At — > as shown in Figure 3.6. The strength of an 
impulse is its area A, where 

A = height h x At. (3.21) 

The Laplace transform of an impulse function is equal to the area of the function. 
The impulse function whose area is unity is called a unit impulse 6(i). 



3.4.2 The step function 



A step function is described as X[(t) = B; X[(s) = B/s for t > (Figure 3.7). For a unit 
step function X[(t) = 1; X[(s) = l/s. This is sometimes referred to as a 'constant 
position' input. 
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m 



Impulse 




Pulse 



Fig. 3.6 The impulse function. 



*i(0 



Fig. 3.7 The step function. 



3.4.3 The ramp function 



A ramp function is described as X[(t) = Qt; X[(s) = Q/s 2 for t > (Figure 3.8). For a 
unit ramp function X[(t) = t; X[(s) = \js 2 . This is sometimes referred to as a 'constant 
velocity' input. 



3.4.4 The parabolic function 



A parabolic function is described as X[(t) = Kt 2 ; X[(s) = 2K/s 3 for t > (Figure 3.9). 
For a unit parabolic function X[(t) = t 2 ; X[(s) = 2/^ 3 . This is sometimes referred to as 
a 'constant acceleration' input. 
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Fig. 3.8 The ramp function. 




Fig. 3.9 The parabolic function. 



3.5 Time domai 
3.5.1 Standard form 



ponse of first-order systems 



Consider a first-order differential equation 

dx 
a— — h bx = cx[(t) 
at 

Take Laplace transforms, zero initial conditions 

asX (s) + bX (s) = cX{(s) 
(as + b)X (s) = cX[(s) 



(3.22) 
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The transfer function is 



G(s) = ^(s) ' 



X[ as + b 

To obtain the standard form, divide by b 



G(s) 



l+fs 



which is written 



G(s) = 



K 



l + Ts 



(3.23) 



Equation (3.23) is the standard form of transfer function for a first-order system, 
where K = steady-state gain constant and T = time constant (seconds). 



3.5.2 Impulse response of first-order systems 

Example 3.4 (See also Appendix 1, examp34.m) 

Find an expression for the response of a first-order system to an impulse function of 

area A. 

Solution 

From Figure 3.10 



X (s) 



or 



*o(s) 



AK AK/T 

l + Ts~ (s + T/T) 

AK ( 1 



T \(s + a) 



(3.24) 



(3.25) 



Equation (3.25) is in the form given in Laplace transform pair 5, Table 3.1, so the 
inverse transform becomes 



x o (0 



AK 



AK 



-t/T 



T T 

The impulse response function, equation (3.26) is shown in Figure 3.11. 



(3.26) 



XAs)=A 




Fig. 3.10 Impulse response of a first-order system. 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC03.3D - 45 - [35-62/28] 9.8.2001 2:26PM 



Time domain analysis 45 




Fig. 3.11 Response of a first-order system to an impulse function of area A 



3.5.3 Step response of first-order systems 



Example 3.5 (See also Appendix 1, examp35.m) 

Find an expression for the response of a first-order system to a step function of 

height B. 



Solution 

From Figure 3.12 



Xois) = ,/**_, = BK 

s(\ + Ts) 



\/T 



s(s+l/T) 



(3.27) 



Equation (3.27) is in the form given in Laplace transform pair 6 Table 3.1, so the 
inverse transform becomes 



jc o (0 = **(l-e-'/ r ) 
If B = 1 (unit step) and K = 1 (unity gain) then 

x (t) = (l - z- t/T ) 



(3.28) 



(3.29) 



When time t is expressed as a ratio of time constant T, then Table 3.2 and Figure 3.13 
can be constructed. 



Table 3.2 Unit step response of a first-order system 



t/T 0.25 0.5 0.75 1 1.5 2 2.5 3 4 

* o (0 0-221 0.393 0.527 0.632 0.770 0.865 0.920 0.950 0.980 
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X ] (s)=B/s 




+ X Q (s) 



Fig. 3.12 Step response of a first-order system. 



3.5.4 Experimental determination of system time constant 
using step response 



Method one: The system time constant is the time the system takes to reach 63.2% of 
its final value (see Table 3.2). 

Method two: The system time constant is the intersection of the slope at t = with 
the final value line (see Figure 3.13) since 



x (t) = 1 - e 



-t/T 



dx ° = 0-(--V' /r = -e-' /r 



At 



dx | 
dt 



1 



\t=o 



at ^ = 



This also applies to any other tangent, see Figure 3.13. 
1.2- 

1 
0.8 



:°o.6 



0.4 



0.2 



0.5 1 



1.5 2 2.5 3 3.5 

Number of Time Constants 



(3.30) 
(3.31) 



T 


i 




T 












% 


W 

































































































4.5 



Fig. 3.13 Unit step response of a first-order system. 
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3.5.5 Ramp response of first-order systems 

Example 3.6 

Find an expression for the response of a first-order system to a ramp function of 

slope Q. 



Solution 

From Figure 3.14 



QK 



QK/T 



A B 



C 



s 2 (\ + Ts) s 2 (s+l/T) s s 2 (s+l/T) 



(3.32) 



(See partial fraction expansion equation (3.13)). Multiplying both sides by 
s 2 (s + l/T), we get 



f = As ( S + -f) +B ( S + 1 T 



i.e. 



QK 



As 1 



A 



-s + Bs 



B 



T T T 

Equating coefficients on both sides of equation (3.33) 

(s 2 ) : = A + C 
(s l ): = ^ + B 



Cs 2 
Cs 2 



(3.33) 

(3.34) 
(3.35) 

(3.36) 



From (3.34) 










C=-A 




From (3.36) 


B = QK 




Substituting into (3.35) 


A = -QKT 




Hence from (3.34) 


C = QKT 




X ] (s) = Q/s? 




K 
1+7s 








w 



X (s) 



Fig. 3.14 Ramp response of a first-order system (see also Figure A1.1). 
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b 
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o 
















d. 
















1 
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3 4 5 

Number of Time Constants 



Fig. 3.15 Unit ramp response of a first-order system. 



Inserting values of A, B and C into (3.32) 

QKT QK QKT 



*o0) : 



s s 2 (s+l/T) 

Inverse transform, and factor out KQ 

x (t) = KQ{t - T + Te~ t/T ^ 

If Q = 1 (unit ramp) and K = 1 (unity gain) then 

x o (0 = t - T + re-'/ r 



(3.37) 



(3.38) 



(3.39) 



The first term in equation (3.39) represents the input quantity, the second is the 
steady-state error and the third is the transient component. When time t is expressed 
as a ratio of time constant T, then Table 3.3 and Figure 3.15 can be constructed. In 
Figure 3.15 the distance along the time axis between the input and output, in the 
steady-state, is the time constant. 

Table 3.3 Unit ramp response of a first-order system 



t/T 





1 


2 


3 


4 


5 


6 


7 


Xi(t)/T 





1 


2 


3 


4 


5 


6 


7 


x (t)/T 





0.368 


1.135 


2.05 


3.018 


4.007 


5 


6 
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3.6 Time domain response of second-order systems 
3.6.1 Standard form 



Consider a second-order differential equation 

cx = ex[(t) (3.40) 



d 2 x dx 



dt 2 dt 

Take Laplace transforms, zero initial conditions 

as 2 X (s) + bsX (s) + cX (s) = eX x (s) 



The transfer function is 



X[ as 2 + bs - 

To obtain the standard form, divide by c 

G(s) 



(as 2 + bs + c)X (s) = eXi(s) (3.41) 



G(s) = ^(s) 



c 



^s 2 + b -s+\ 

c c 

which is written as 



This can also be normalized to make the s 2 coefficient unity, i.e. 

s z + 2Cu n s + ou^ 

Equations (3.42) and (3.43) are the standard forms of transfer functions for a second- 
order system, where K = steady-state gain constant, co n = undamped natural 
frequency (rad/s) and ( = damping ratio. The meaning of the parameters co n and ( 
are explained in sections 3.6.4 and 3.6.3. 

3.6.2 Roots of the characteristic equation and their 

relationship to damping in second-order systems 

As discussed in Section 3.1, the transient response of a system is independent of the 
input. Thus for transient response analysis, the system input can be considered to be 
zero, and equation (3.41) can be written as 

(as 2 + bs + c)X (s) = 

lfX (s) t^O, then 

as 2 + bs + c = (3.44) 
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Table 3.4 Transient behaviour of a second-order system 



Discriminant Roots 



Transient response type 



b 2 > 4ac s\ and S2 real 

and unequal 

(-ve) 
b 2 = Aac s\ and S2 real 

and equal 

(-ve) 

b 2 < Aac s\ and S2 complex 

conjugate of the 
form: s\, S2 = -a±juj 



Overdamped 

Transient 

Response 

Critically 

Damped Transient 
Response 

Underdamped 

Transient 

Response 



This polynomial in s is called the Characteristic Equation and its roots will determine 
the system transient response. Their values are 



s u s 2 



-b ± Vb 2 - Aac 
2a 



(3.45) 



The term (b 2 — 4ac), called the discriminant, may be positive, zero or negative which 
will make the roots real and unequal, real and equal or complex. This gives rise to the 
three different types of transient response described in Table 3.4. 

The transient response of a second-order system is given by the general solution 



x (t) = Ae Slt + Be S2t 
This gives a step response function of the form shown in Figure 3.16. 



(3.46) 



x Q (t) 



Underdamping (si and s 2 complex) 




Critical damping 
and s 2 real and equal) 



Overdamping 

s 2 real and unequal) 



Fig. 3.16 Effect that roots of the characteristic equation have on the damping of a second-order system. 
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3.6.3 Critical damping and damping ratio 

Critical damping 

When the damping coefficient C of a second-order system has its critical value C c , the 
system, when disturbed, will reach its steady-state value in the minimum time without 
overshoot. As indicated in Table 3.4, this is when the roots of the Characteristic 
Equation have equal negative real roots. 

Damping ratio £ 

The ratio of the damping coefficient C in a second-order system compared with the 
value of the damping coefficient C c required for critical damping is called the 
Damping Ratio ( (Zeta). Hence 



( 



c 



(3.47) 



Thus 



( = No damping 

C < 1 Underdamping 

( = 1 Critical damping 

( > 1 Overdamping 

Example 3.7 

Find the value of the critical damping coefficient C c in terms of K and m for the 

spring-mass-damper system shown in Figure 3.17. 



▼ 
xjf) 




Kx„ Cx 




x {t) 

*o(t) 

m 



Lumped Parameter Diagram 
(a) 



Free-Body Diagram 
(b) 



Fig. 3.17 Spring-mass-damper system. 
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Solution 

From Newton's second law 

2_^ Fx = mx 

From the free-body diagram 

F(t) - Kx (t) - Cx (t) = mx (t) (3.48) 

Taking Laplace transforms, zero initial conditions 

F(s) - KX (s) - CsX (s) = ms 2 X (s) 
or 

(ms 2 + Cs + K)X (s) = F(s) (3.49) 

Characteristic Equation is 

ms 2 + Cs + ^ = 



,.2 



c ^ 



i.e. s z -\ h — = 

m m 

and the roots are 



1|C, / fC\ 2 K 



s u s 2 = -t-±i - -4-} (3.50) 

2 m y \mj m 

For critical damping, the discriminant is zero, hence the roots become 



Also, for critical damping 



= ^2 


2m 


c 2 


AK 


m 2 


m 


cl = 


4Km 2 



m 



giving 



C c = 2VKm (3.51) 



3.6.4 Generalized second-order system response to a unit step 
input 

Consider a second-order system whose steady-state gain is K, undamped natural 
frequency is co n and whose damping ratio is (, where £ < 1 . For a unit step input, the 
block diagram is as shown in Figure 3.18. From Figure 3.18 

X °^ = (2^^ I 2, ( 3 - 52 ) 
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X i (s) = Ms 



Ku 2 n 



S +2(cJ n S + ScJ n 2 



_* (S) 



Fig. 3.18 Step response of a generalized second-order system for £ < 1. 
Expanding equation (3.52) using partial fractions 

XJA A & + C 



s (s 2 + 2(u n s + col) 



Equating (3.52) and (3.53) and multiply by s[s 2 + 2(cu n s 



KujI = A(s 2 + 2(uj n s + uol) + Bs 2 + Cs 



Equating coefficients 



(* 2 ) 
(s°) 



= A + B 

= 2CcJ n ^4 + C 
Ku 2 n = u; 2 n A 



giving 



A = K, B = -K and C = -2(oj n K 
Substituting back into equation (3.53) 



X (s) = K 
Completing the square 

X (s) = K 



i f s + 2(uu n y 

s \s 2 + 2(ou n s + oul J _ 



1 



s + 2(uj n 



K 



s + 2(oo n 



(s + c^n) 2 + (c^yr^y 



(3.53) 



(3.54) 



The terms in the brackets { } can be written in the standard forms 10 and 9 in 
Table 3.1. 

c 

Term (1) 



(^C^+^nV^^C 2 )^ 



Term (2) = — < 



2(u n 



'nV'W 2 " 



, C4 



(J, 



nV^C 



j^ + C^nf+^nV^^C 2 ) , 
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Inverse transform 



x (t) = K 



1 - Je-^Mcos^nVl-C 2 )^- ^ ^-^ sin^nVl-C 2 )/ 
f 2C >l {e-^(sm(^v / r^)^)} 



Equation (3.55) can be simplified to give 



x o (0 = K 
When C = 



1 -e-^jcos^^W 2 )^ \-7==\ sin(^ n yr^) 
x (t) = K[\ - e°{coso; n f + 0}] 

= K[\ — COSCc; n (] 



(3.55) 



(3.56) 



(3.57) 



From equation (3.57) it can be seen that when there is no damping, a step input will 
cause the system to oscillate continuously at u n (rad/s). 

Damped natural frequency 6> d 

From equation (3.56), when < (> 1, the frequency of transient oscillation is 
given by 



^d = ^n\/l - C 2 



(3.58) 



where co^ is called the damped natural frequency. Hence equation (3.56) can be 
written as 



x (t) = K 



K 



1 -e- CaV icos^+ [— F £==| 



sin u&t 



-(u n t 



where 



v^ 



tan< 



sm(iOdt + 4>) 



c 



When ( = 1, the unit step response is 

x (t) = K[l-e- w * t (l+u n t)] 
and when ( > 1, the unit step response from equation (3.46) is given by 



(3.59) 
(3.60) 

(3.61) 
(3.62) 



x Q (t) = K 






(3.63) 
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u n t (rad) 

Fig. 3.19 Unit step response of a second-order system. 

The generalized second-order system response to a unit step input is shown in Figure 
3.19 for the condition K = 1 (see also Appendix 1, sec_ord.m). 



■3.7 Step response analysis and performance 
specification 




3.7.1 Step response analysis 



It is possible to identify the mathematical model of an underdamped second-order 
system from its step response function. 

Consider a unity- gain (K = 1) second-order underdamped system responding to 
an input of the form 



X[(t) = B 



(3.64) 



The resulting output x (t) would be as shown in Figure 3.20. There are two methods 
for calculating the damping ratio. 



Method (a) : Percentage Overshoot of first peak 



Now 



%Overshoot = ^ x 100 



a x = BQ~ Cu;n{T/2) 



(3.65) 
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x (t) 



i 
B 


r 


A 

B 





\a^^ (with reference to final value) 
^\ I* 1 


/ i 


k \^ ^ A 






4 t/2 t 


4 T fc 


1 









Fig. 3.20 Step response analysis. 



Thus, 



fi Q -CUn(T/2) 

% Overshoot = x 100 

B 



Since the frequency of transient oscillation is cjd, then, 

2tt 



UJ d 



2tt 



(3.66) 



(3.67) 



Substituting (3.67) into (3.66) 

%Overshoot = Q-^^/^y/i^ x 100 
%Overshoot = Q -^/V^ 
Method (b)\ Logarithmic decrement. Consider the ratio of successive peaks a\ and a 2 

a x = Bq~ Cuj ^ 2) (3.69) 

a 2 = Bq-^ t/1) (3.70) 



(3.68) 



Hence 



-<Mt/2) 



Oj__ 

a 2 ~ Q-C^nOr/2) 



.{-Ca; n (r/2)+Cc n (3r/2)} 



= e C^ n r = e 2C7r/Vl-C 2 



(3.71) 
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Equation (3.71) can only be used if the damping is light and there is more than one 
overshoot. Equation (3.67) can now be employed to calculate the undamped natural 
frequency 



2tt 



-vr^e 



(3.72) 



3.7.2 Step response performance specification 



The three parameters shown in Figure 3.21 are used to specify performance in the 
time domain. 

(a) Rise time t r \ The shortest time to achieve the final or steady-state value, for the 
first time. This can be 100% rise time as shown, or the time taken for example 
from 10% to 90% of the final value, thus allowing for non-overshoot response. 

(b) Overshoot. The relationship between the percentage overshoot and damping 
ratio is given in equation (3.68). For a control system an overshoot of between 
and 10% (1 < C > 0.6) is generally acceptable. 

(c) Settling time t s : This is the time for the system output to settle down to within a 
tolerance band of the final value, normally between ±2 or 5%. 



Using 2% value, from Figure 3.21 



Invert 



0.02B = £e _CaVs 
50 = Q C ^ ts 



x (t) 



/ J 


Be** 
- (with reference to final value) 

Overshoot ± 2 or 5% of B 

r^~ - i 


r \ ~~~~~-^~ ^zrr^~_ 


I ^ 




\^ ^ re ^ r ' '" 


s'''' 


x 


Rise 




t 


Time t x 

< 


Settlin 


g Time t s 

► 





Fig. 3.21 Step response performance specification. 
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Take natural logs 



In 50 = C^n4 



giving 



C^n 



In 50 



(3.73) 



The term (l/(uj n ) is sometimes called the equivalent time constant T c for a second- 
order system. Note that In 50 (2% tolerance) is 3.9, and In 20 (5% tolerance) is 3.0. 
Thus the transient period for both first and second-order systems is three times the 
time constant to within a 5% tolerance band, or four times the time constant to 
within a 2% tolerance band, a useful rule- of- thumb. 



3.8 Response of higher-order systems 



Transfer function techniques can be used to calculate the time response of higher- 
order systems. 

Example 3.8 (See also Appendix 1, examp38.m) 

Figure 3.22 shows, in block diagram form, the transfer functions for a resistance 
thermometer and a valve connected together. The input X{(t) is temperature and the 
output x (t) is valve position. Find an expression for the unit step response function 
when there are zero initial conditions. 



Solution 

From Figure 3.22 



X (s) = 



25 



s(l + 2s)(s 2 + s + 25) 
12.5 



s(s + 0.5)(s 2 + s + 25) 

A B Cs + D 



s (.s + 0.5) (s + 0.5) 2 + (4.97) 2 



(3.74) 
(3.75) 
(3.76) 



Resistance Thermometer 



X,(s)=Ms 



Valve 




*A(s) 



Fig. 3.22 Block diagram representation of a resistance thermometer and valve. 
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Note that the second-order term in equation (3.76) has had the 'square' completed 
since its roots are complex (b 2 < Aac). Equate equations (3.75) and (3.76) and multi- 
ply both sides by s(s + 0.5)(s 



12.5 



s + 25). 

: (s 3 + 1.5s 2 + 25.5s + \2.5)A + (s 3 ■ 
+ (s 3 + 0.5s 2 )C + (s 2 + 0.5s)D 



25s)B 



(3.77) 



Equating coefficients 



(s 3 ) 

(s 2 ) 
(s l ) 



0=A+B+C 

0= 1.5,4 +£ + 0.5C + Z> 

= 25.5A + 25B + 0.5D 



12.5 = 12.5.4 

Solving the four simultaneous equations 

A = l, 5= -1.01, C 

Substituting back into equation (3.76) gives 

, N 1 1.01 

X (s) = --- 

s 

Inverse transform 

x (t) = l - 1.01e-°- 5r -0.01e- - 5r (10.16sin4.97^-cos4.970 



0.01, 2) = -0.5 



0.01s -0.5 



(j + 0.5) (s + 0.5) 2 + (4.97) 2 



(3.78) 



(3.79) 



Equation (3.79) shows that the third-order transient response contains both first- 
order and second-order elements whose time constants and equivalent time constants 
are 2 seconds, i.e. a transient period of about 8 seconds. The second-order element 
has a predominate negative sine term, and a damped natural frequency of 4.97rad/s. 
The time response is shown in Figure 3.23. 




Fig. 3.23 Time response of third-order system. 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC03.3D- 



- [35-62/28] 9.8.2001 2:27PM 



60 Advanced Control Engineering 

3.9 Further problems 

Example 3.9 

A ship has a mass m and a resistance C times the forward velocity u(t). If the thrust 

from the propeller is K times its angular velocity uo(t), determine: 

(a) The first-order differential equation and hence the transfer function relating U(s) 

and uj(s). 

When the vessel has the parameters: m = 18 000 x 10 3 kg, C = 150 000Ns/m, and 
^ = 96 000Ns/rad, find, 

(b) the time constant. 

(c) an expression for the time response of the ship when there is a step change of cu(t) 
from to 12.5rad/s. Assume that the vessel is initially at rest. 

(d) What is the forward velocity after 
(i) one minute 

(ii) ten minutes. 

Solution 

(a) m(du/dt) + Cu = Kco(t) 

E {s)= K ' c 

uo y ) 1 + (m/C)s 

(b) 120 seconds 

(c) u(t) = 8(1 - e-° 00833 

(d) (i) 3.148m/s 
(ii) 7.946 m/s 

Example 3.10 

(a) Determine the transfer function relating ^(s) and V\(s) for the passive electrical 
network shown in Figure 3.24. 

(b) When C = 2 |iF and R\ = R 2 = 1 M^, determine the steady-state gain K and 
time constant T. 

(c) Find an expression for the unit step response. 




Fig. 3.24 Passive electrical network. 
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Solution 










(a) 


V^ (^ 




R2/R1 


+ i?2 




1 + (R1B2C/R1 + 


*2> 


(b) 


0.5 

1.0 seconds 








(c) 


Vo(0 = 


= 0.5(1 


-e"') 







Example 3.11 

Determine the values of ui n and ( and also expressions for the unit step response for 

the systems represented by the following second-order transfer functions 

(0 ~t (s) = 0.25s 2 +s+\ 

(11) aT (5) = ?T67T5 



(n0|(,) = ^ 



1 



Solution 

(i) 2.0 

1 .0 (Critical damping) 
x (t) = 1 - Q~ 2t (l + 20 

(ii) 2.236 

1.342 (Overdamped) 

x o (0 = 2-2.5e-' + 0.5e- 5r 

(iii) 1.0 

0.5 (Underdamped) 

x (t)= 1 -e-°- 5r (cos0.866^ + 0.577 sin 0.8660 

Example 3.12 

A torsional spring of stiffness K, a mass of moment of inertia / and a fluid damper 
with damping coefficient C are connected together as shown in Figure 3.25. The 
angular displacement of the free end of the spring is 6{{i) and the angular displace- 
ment of the mass and damper is o (t). 



](t) 



n 



u 

c 



o (t) 



Fig. 3.25 Torsional system. 
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(a) Develop the transfer function relating 0[(s) and o (s). 

(b) If the time relationship for 6{{i) is given by 6{(i) = At then find an expression for 
the time response of o (t). Assume zero initial conditions. What is the steady- 
state error between 0{(f) and 6 (t)l 

Solution 
(a) tt(j) 



(b) <9 o (0 = 4f - 0.2 + e- 2 - 5 '(0.2 cos 9.682; - 0.361 sin 9.6820 
0.2 radians. 

Example 3.13 

When a unity gain second-order system is subject to a unit step input, its transient 

response contains a first overshoot of 77%, occurring after 32.5 ms has elapsed. Find 

(a) the damped natural frequency 

(b) the damping ratio 

(c) the undamped natural frequency 

(d) the system transfer function 

(e) the time to settle down to within ±2% of the final value 

Solution 

(a) 96.66 rad/s 

(b) 0.083 

(c) 96.99 rad/s 

(d) G(s) 



1 



1.712 x 10- 3 s+l 



(e) 0.486 seconds 



Example 3.14 

A system consists of a first-order element linked to a second-order element without 
interaction. The first-order element has a time constant of 5 seconds and a steady- 
state gain constant of 0.2. The second-order element has an undamped natural 
frequency of 4 rad/s, a damping ratio of 0.25 and a steady-state gain constant of 
unity. 

If a step input function of 10 units is applied to the system, find an expression for 
the time response. Assume zero initial conditions. 

Solution 

x (t) = 2.0 - 2.046e-°- 2 ' + e~' (o.046 cos \^\5t - 0.094 sin V\5t 
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Closed-loop control 
systems 



4.1 Closed-loop transfer function 

Any system in which the output quantity is monitored and compared with the input, 
any difference being used to actuate the system until the output equals the input is 
called a closed-loop or feedback control system. 

The elements of a closed-loop control system are represented in block diagram 
form using the transfer function approach. The general form of such a system is 
shown in Figure 4.1. 

The transfer function relating R(s) and C(s) is termed the closed-loop transfer 
function. 

From Figure 4.1 

C(s) = G(s)E(s) (4.1) 

B(s) = H(s)C(s) (4.2) 

E(s) = R(s) - B(s) (4.3) 

Substituting (4.2) and (4.3) into (4.1) 

C(s) = G(s){R(s) - H(s)C(s)} 
C(s) = G(s)R(s) - G(s)H(s)C(s) 
C(s){l + G(s)H(s)} = G(s)R(s) 

£ (s) = G ^ (4 4) 

R {) l + G(s)H(s) ( ' 

The closed-loop transfer function is the forward-path transfer function divided by 
one plus the open-loop transfer function. 
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Forward Path 



Summing 
point 




Take-off 

point C(s) 

► 



B(s) 




Feedback Path 

Fig. 4.1 Block diagram of a closed-loop control system. R(s) = Laplace transform of reference input r(t); 
C(s) = Laplace transform of controlled output c(t); B(s) = Primary feedback signal, of value H(s)C(s); 
E(s) = Actuating or error signal, of value R(s) - B(s); G(s) = Product of all transfer functions along the 
forward path; H(s) = Product of all transfer functions along the feedback path; G(s)H(s) = Open-loop 
transfer function; ® = summing point symbol, used to denote algebraic summation; • = Signal take-off 
point; — > = Direction of information flow. 



4.2 Block diagram reduction 
4.2.1 Control systems with multiple loops 



A control system may have several feedback control loops. For example, with a ship 
autopilot, the rudder-angle control loop is termed the minor loop, whereas the 
heading control loop is referred to as the major loop. When analysing multiple loop 
systems, the minor loops are considered first, until the system is reduced to a single 
overall closed-loop transfer function. 

To reduce complexity, in the following examples the function of s notation (s) used 
for transfer functions is only included in the final solution. 



Example 4.1 

Find the closed-loop transfer function for the system shown in Figure 4.2. 

Solution 

In Figure 4.2, the first minor loop to be considered is G3H3. Using equation (4.4), this 

may be replaced by 



Jml 



G 3 
1 + G 3 H 3 



(4.5) 
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First Minor Loop 



Cascade 



R(s) + 



<$)-* a 



-►&» a 



&H> 



H 4 



Fig. 4.2 Multiple loop control system. 



C(s) 



Now G m i is multiplied by, or in cascade with G 2 . Hence the combined transfer 
function is 



GiGmi = 



G 2 G 



1 + G 3 H 3 



(4.6) 



The reduced block diagram is shown in Figure 4.3. 

Following a similar process, the second minor loop G m2 may be written 



G2G3 



U ™2 - -, , G 2 G 3 H 2 
1 " r I+G3//3 



Multiplying numerator and denominator by 1 + G 3 H 3 

G2G3 



G m 2 



1 + G 3 H 3 + G2G3//2 
But G m 2 is in cascade with Gi, hence 

G1G2G3 



GiG m 2 



1 + G 3 H 3 + G2G3H2 



(4.7) 



Transfer function (4.7) now becomes the complete forward-path transfer function as 
shown in Figure 4.4. 
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Cascade 



Second Minor Loop 



R(s) 



Fig. 4.3 First stage of block diagram reduction. 



R(s) 



-i 































*—fri^ 


G, 


^o^^ 


G 2 G 3 
1 + G 3 H 3 




C(s) 




y 


i 


k 








^ 





















Hz 4 
















































u 
















' '1 




4 











^ ► 




G1G2G3 






C(s) 


^ 

L 


1 + G3H3 + G2G3H2 




> ► 
















Hi 










^ 







Fig. 4.4 Second stage of block diagram reduction. 



The complete, or overall closed-loop transfer function can now be evaluated 

G\ G2C/3 



S w = 7 



1 + G3 //3 + G2 G3 //2 



I + G3 // 3 + G2 G3 // 2 

Multiplying numerator and denominator by 1 + G3//3 + G 2 G 3 H 2 



C 



is) 



G l (s)G 2 (s)G i (s) 



tf w 1 + G3(s)H 3 (s) + G 2 (s)G 3 (s)H 2 (s) + G x (s)G 2 (s)G 3 {s)H x (s) 



(4.8) 
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4.2.2 Block diagram manipulation 



There are occasions when there is interaction between the control loops and, for the 
purpose of analysis, it becomes necessary to re-arrange the block diagram configur- 
ation. This can be undertaken using Block Diagram Transformation Theorems. 



Table 4.1 Block Diagram Transformation Theorems 



Transformation 



Equation 



Block diagram 



Equivalent block diagram 



1. Combining 
blocks in 
cascade 



Y=(G l G 2 )X 



X 


G, 




g 2 







X 



> G,G 2 



2. Combining 
blocks in 
parallel; or 
eliminating a 
forward loop 



3. Removing a 
block from 
a forward 
path 

4. Eliminating 
a feedback 
loop 



5. Removing a 
block from 
a feedback 
loop 



Y=G l X±G 2 X 



X 



X 



' A + 



G,±G 2 



Y=GiX+G 2 X 



Y=G l (X±G 2 Y) 



X 



Gi 



Vfi 






Y=Gi(X±G 2 Y) 



<3i 



G 2 < 



X 


G, 


► 


1±G,G 2 



X 



nm 



G A G 2 



*-► 



6. Rearranging 
summing 
points 



Z=W±X±Y 



-i®-* 



^fr^frz 



7. Moving a 
summing 
point ahead 
of a block 



X 



Z=GX±Y 



+ ^ 



iV + 



►<§) — ► 


G - 


M- + i 





i. Moving a 
summing 
point 
beyond 
a block 



Z=G(X±Y) 



— ►&> — ► 



A± 



X 
Y 



4+ Z 



9. Moving a 
take-off 
point ahead 
of a block 

10. Moving a 
take-off 
point beyond 
a block 



F=GX 



F=GX 



X 


G 




Y 






w 


Y 

A — 















G 




' w 


G 


<- 





X 




G 


Y 




w 


w 


X 







X 



X 






G 












<<- 


1 

G 
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Example 4.2 

Moving a summing point ahead of a block. 

Equation 
Z = GX±Y 



Equation 

Z = {X±(l/G)Y}G 

Z = GX±Y 



(4.9) 



A complete set of Block Diagram Transformation Theorems is given in Table 4.1. 



Example 43 

Find the overall closed-loop transfer function for the system shown in Figure 4.6. 

Solution 

Moving the first summing point ahead of G\ 9 and the final take-off point beyond G4 
gives the modified block diagram shown in Figure 4.7. The block diagram shown in 
Figure 4.7 is then reduced to the form given in Figure 4.8. The overall closed-loop 
transfer function is then 

^ G1G2G3G4 

W c x _ _ (l+G l G 2 H l )(\+G 3 G 4 H 2 ) 

R {S) ~l 



QxGiGiQ^Hs 



(0 l 4 )(l+G l G2H l )(l+GiG 4 H 2 ) 



(1 + G l (s)G 2 (s)H l ( S ))(\ + G } (s)G 4 (s)H 2 (s)) + G 2 (s)G 3 (s)H 3 (s) 



(4.10) 



X 

► 


G 


Y 


x -^- 


G 


Z 
► 








► 








1 
G 


«-^ 



Fig. 4.5 Moving a summing point ahead of a block. 



Ahead 



R(s) + 



— ►&-► G i -+&+ G '< 



+ X 



Hi < 



H 3 4 



^k 



G 3 



Beyond 





41 C(s) 


G 4 







H 2 < 



Fig. 4.6 Block diagram with interaction. 
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ft 



H 3 



R{ U&- 



GaGo 



Hi < 



Fig. 4.7 Modified block diagram with no interaction. 



R(s) 



_Hs_ 
GiG 4 



G^G 2 



"[+G1G2H, 
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G 4 



G 3 Ga 



G3G4 



1 + G3G4H0 



Fig. 4.8 Reduced block diagram. 



C(s) 

-► 



C(s) 

-► 



4.3 Systems with multiple inputs 
4.3.1 Principle of superposition 



A dynamic system is linear if the Principle of Superposition can be applied. This 
states that The response y(t) of a linear system due to several inputs x\(t), 
X2(t), . . . , x n (t), acting simultaneously is equal to the sum of the responses of each 
input acting alone'. 

Example 4.4 

Find the complete output for the system shown in Figure 4.9 when both inputs act 

simultaneously. 

Solution 

The block diagram shown in Figure 4.9 can be reduced and simplified to the form 
given in Figure 4.10. Putting R2(s) = and replacing the summing point by +1 gives 
the block diagram shown in Figure 4. 1 1 . In Figure 4. 1 1 note that C 1 (s) is response to 
R\(s) acting alone. The closed-loop transfer function is therefore 

r^\ G\G 2 

M = l+G2Hl 

R{ W J _l_ G1G2H1 



l+G 2 H 2 
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or 



C\s) 



G l (s)G 2 (s)R l (s) 



1 + G 2 (s)H 2 (s) + Gi0)(72(5)#i0) 



(4.11) 



Now if R\(s) = and the summing point is replaced by —1, then the response C ll (s) 
to input R2(s) acting alone is given by Figure 4.12. The choice as to whether 
the summing point is replaced by + 1 or — 1 depends upon the sign at the summing 
point. 

Note that in Figure 4.12 there is a positive feedback loop. Hence the closed-loop 
transfer function relating 7? 2 (V) and C u (s) is 



&2 1 



-G X G 2 H X 
l+G 2 H 2 



f -G l G 2 H x \ 
\ \+G 2 H 2 ) 




Hi 




R 2 (s) 



H 2 



Fig. 4.9 System with multiple inputs. 




C(s) 
f ► 




Fig. 4.10 Reduced and simplified block diagram. 
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1 + G 2 H 2 



Closed-loop control systems 71 



C\s) 
* ► 



Hi 



+1 < 



Fig. 4.1 1 Block diagram for /?! (s) acting alone. 



R 2 (s) 







^ 






GiG 2 
1 + G 2 H 2 


_^ii 


A > 


H, 


-1 


C(s) 


jy 




► 


( 


> — r 

















Fig. 4.12 Block diagram for fi 2 (s) acting alone. 



or 



C%) = 



-Gi(j)G 2 (j)gi(^ 2 (j) 
1 + G2(.s)H 2 (s) + G^G^H^s) 



(4.12) 



It should be noticed that the denominators for equations (4.11) and (4.12) are 
identical. Using the Principle of Superposition, the complete response is given by 



or 



C(s) 



C(s) = C l (s) + C u (s) 



(G l (s)G 2 (s))R l (s) - (G l (s)G 2 (s)H l (s))R 2 (s) 
1 + G 2 (s)H 2 (s) + G x (s)G 2 (s)H x (s) 



(4.13) 



(4.14) 



4.4 Transfer functions for system elements 
4.4.1 DC servo-motors 



One of the most common devices for actuating a control system is the DC servo- 
motor shown in Figure 4.13, and can operate under either armature or field control. 

(a) Armature control: This arrangement is shown in schematic form in Figure 4.14. 
Now air gap flux $ is proportional to if, or 



$ = Ktik 



(4.15) 
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(a) Physical Arrangement 



Armature 
winding 

Ral La 



R, 



«0 



fli(0 



I — I 


~~ | — nmnnnn* 


/«0 


f — 


J.^.- 


-r^ «o. "(0 

1 o 



e a (0 



(b) Schematic Diagram 
Fig. 4.13 Simple DC servo-motor. 

where K^ is the field coil constant. 

Also, torque developed T m is proportional to the product of the air gap flux and 
the armature current 



T m (t) = &Kam*a(0 



(4.16) 
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Fig. 4.14 DC servo-motor under armature control. e a (t) = Armature excitation voltage; eb(f) = Backemf; 
4(f) = Armature current; R a = Armature resistance; L a = Armature inductance; ef = Constant field 
voltage; /f = Constant field current; 7~ m = Torque developed by motor; 9(f) = Shaft angular displacement; 
uj{f) = Shaft angular velocity = dO/dt 



where K am is the armature coil constant. 
Substituting (4.15) into (4.16) gives 

T m (t) = (K m K am i f )Ut) 
Since if is constant 

T m (i) = KMt) 

where the overall armature constant K a is 

K& = KfaK am if 



(4.17) 



(4.18) 



(4.19) 



When the armature rotates, it behaves like a generator, producing a back emf ^(0 
proportional to the shaft angular velocity 



An 

e h {i) = K h — = K h uj{t) 
at 

where ^b is the back emf constant. 

The potential difference across the armature winding is therefore 



(4.20) 



e a (0 - e b (t) = L a -T7 + ^a4 



(4.21) 



Taking Laplace transforms of equation (4.21) with zero initial conditions 

E a (s) - E b (s) = (L a s + R a )I a (s) (4.22) 

Figure 4.15 combines equations (4.18), (4.20) and (4.22) in block diagram form. 
Under steady-state conditions, the torque developed by the DC servo-motor is 

K a 



T m (t) = K(0 - KbuKt)} 



R» 
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Fig. 4.1 5 Block diagram representation of armature controlled DC servo-motor. 



or 



T m (t) 



Ca(0 



K a Kb 



co(t) 



CJ(S) 



(4.23) 



From equation (4.23), the relationship between T m (t), co(t) and E a (t) under steady- 
state conditions is shown in Figure 4.16. 

(b) Field control: This arrangement is shown in schematic form in Figure 4.13, 
with the exception that the armature current 4 is held at a constant value. Equation 
(4.17) may now be written as 



T m (t) = (K m K am i a )i f (t) 
and since / a is a constant, then 

T m (t) = Kfkit) 
where the overall field constant Kf is 

Kf = Xfd^amZ'a 



(4.24) 
(4.25) 

(4.26) 



In this instance, the back emf e\> does not play a part in the torque equation, but it 
can produce difficulties in maintaining a constant armature current 4- 
The potential difference across the field coil is 

e ( (t) = Lr^ + ltfk (4.27) 

Taking Laplace transforms of equation (4.27) with zero initial conditions 

Ef(s) = (Lts + Rf)I f (s) (4.28) 

Figure 4.17 combines equations (4.25) and (4.28) in block diagram form. 
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Fig. 4.16 Steady-state relationship between 7~ m (f), uj(t) and e a (t) for an armature controlled DC servo- 
motor. 
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Fig. 4.17 Block diagram representation of field controlled DC servo-motor. 



Under steady-state conditions, the torque developed by the DC servo-motor is 

r m (0=(^)«f(0 (4-29) 

The relationship between T m (i), ef(t) and u(t) under steady-state conditions is shown 
in Figure 4.18. 



4.4.2 Linear hydraulic actuators 



Hydraulic actuators are employed in such areas as the aerospace industry because 
they possess a good power to weight ratio and have a fast response. 

Figure 4.19 shows a spool-valve controlled linear actuator. When the spool-valve 
is moved to the right, pressurized hydraulic oil flows into chamber (1) causing the 
piston to move to the left, and in so doing forces oil in chamber (2) to be expelled to 
the exhaust port. 

The following analysis will be linearized for small perturbations of the spool-valve 
and actuator. 
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Fig. 4.18 Steady-state relationship between T m (t), ef(f) and uj(t) for a field controlled DC servo-motor. 
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Fig. 4.19 Spool-valve controlled linear actuator. 



It is assumed that: 

the supply pressure P s is constant 

the exhaust pressure P Q is atmospheric 

the actuator is in mid-position so that V\ = V2 = F which is half the total volume 

of hydraulic fluid V t 

the hydraulic oil is compressible 

the piston faces have equal areas A 

Qx and Q2 are the volumetric flow-rates into chamber (1) and out of chamber (2) 

the average, or load flow-rate 2l has a value (Q\ + Qi)/2 

P\ and P 2 are the fluid pressures in chamber (1) and chamber (2) 

the load pressure P^ has a value (P\ — P2) 
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(a) Actuator analysis: The continuity equation for the chambers may be written 

y^ 2in — ^ 2out = ( r ^te of change of chamber volume) 

+ (rate of change of oil volume) (4.30) 

In equation (4.30), the rate of change of chamber volume is due to the piston 
movement, i.e. dV/dt. The rate of change of oil volume is due to compressibility 
effects, i.e.: 

Bulk Modulus of oil, (3 = Volumetric stress/Volumetric strain 

P = ^VJv (431) 

Note that in equation (4.31) the denominator is negative since an increase in pressure 
causes a reduction in oil volume. 
Hence 

dV _ dP 



Giving, when differentiated with respect to time 

dV _ (V\dP 
~dt~~ \J3) d7 

For chamber (1), equation (4.30) may be expressed as 



(4.32) 



and for chamber (2) 



Now 



dV\ fV\\dP\ 
C ,_ e ,„ k = _LW_LJ_l (4 .33) 



• . dV 2 fy 2 \dp 2 „„„, 



a Q1 + Q2 
Ql = ^— 

Thus, from eqations (4.33) and (4.34) 

• . 1 fdV x dV 2 \ 1 / dPi dP 2 \ 

If leakage flow-rate 2i ea k is laminar, then 

gleak = C P P L (4.36) 
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where C p is the leakage coefficient. Also, if V\ = V2 = V , then 

dF 2 _dFi _dV 

dt ~ dt ~ d^ 

Hence equation (4.35) can be written 



(4.37) 



or 



where 



and 



g L = Ce P L+ f + ^(P,-P 2 > (438) 



&-™+*Tr + w£ <«» 



dr <Lr 
d? d? 



-4 



(b) Linearized spool-valve analysis: Assume that the spool-valve ports are rectan- 
gular in form, and have area 



A y = WX V (4.40) 



where W is the width of the port. 
From orifice theory 



Qi = C d WX y J-(P s -Pi) (4.41) 



and 



Q 2 = C d WX y J-(P 2 -0) (4.42) 

whereo C d is a coefficient of discharge and p is the fluid density. 
Equating (4.41) and (4.42) 

Ps~Pi= Pi (4.43) 

since 

Pl = Pi~ Pi 
Equation (4.43) may be re-arranged to give 

Pi = ^^ (4.44) 
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From equations (4.41) and (4.42) the load flow-rate may be written as 



Q L = Q WX V J- (^y^) (4-45) 

Hence 

Q L = F(X Yl P L ) (4.46) 

Equation (4.45) can be linearized using the technique described in section 2.7.1. If #l, 
x v and j9 L are small perturbations of parameters g L? Xy and P L about some operat- 
ing point 'a', then from equation (4.46) 






OQi 



dP L 



PL (4.47) 



or 



where 



q L = K q x Y - K c p L (4.48) 



K q (flow gain) = Q wJ- (P 8 - i> La ) (4.49) 



and 

(flow-pressure coefficient which has a negative value) 



Note that i^a and X va are the values of P^ and X v at the operating point 'a'. 

The relationship between g L , P L and X y , from equation (4.45), together with the 
linearized relations #l, Pl and x v are shown in Figure 4.20. 

Equation (4.39) is true for both large and small perturbations, and so can be 
written 

Equating (4.48) and (4.51) gives 

K, x „ = A^ + (Cr + K c)PL+ ^ (4.52) 

Taking Laplace transforms (zero initial conditions), but retaining the lower-case 
small perturbation notation gives 

K q x v (s) = Asx (s) + J (C P + K c ) + ^L(j) (4.53) 
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/ Relationship 




P s Pl (Pa) 



Fig. 4.20 Pressure-Flow-rate characteristics for a spool-valve. 



The force to accelerate the mass m is shown in Figure 4.21. From Figure 4.21 



mx 
AP^= mx 



(4.54) 



Take Laplace transforms with zero initial conditions and using lower-case notation 



in 



Pl(s) = —s x (s) 



Inserting equation (4.55) into (4.53) gives 

K q x Y (s) = Asx (s) + J (C P + K c ) + j-s \ (^s 2 ^jx (s) 



(4.55) 



(4.56) 



Equation (4.56) may be re-arranged to give the transfer function relating x (s) and 
x v (s) 




Xo(t), X (f), Ut) 



Fig. 4.21 Free-body diagram of load on hydraulic actuator. 
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Equation (4.57) can be written in the standard form 
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(4.57) 



— (s) 



K h 



J± s 2 + 2(L s+ {\ 

\"4 w »" / 



(4.58) 



where 



Kb (hydraulic gain) = — ^ 



cj n h (hydraulic natural frequency) = 



Ch (hydraulic damping ratio) 




Since the Bulk Modulus of hydraulic oil is in the order of 1 .4 GPa, if m and V t are 
small, a large hydraulic natural frequency is possible, resulting in a rapid response. 
Note that the hydraulic damping ratio is governed by Cp and K c . To control the level 
of damping, it is sometimes necessary to drill small holes through the piston. 



4.5 Controllers for closed-loop systems 
4.5.1 The generalized control problem 



A generalized closed-loop control system is shown in Figure 4.22. The control 
problem can be stated as: 'The control action u(t) will be such that the controlled 
output c(t) will be equal to the reference input r\(f) for all values of time, irrespective 
of the value of the disturbance input ^(0'- 

In practice, there will always be transient errors, but the transient period should be 
kept as small as possible. It is usually possible to design the controller so that steady- 
state errors are minimized, or ideally, eliminated. 



Ki(s) + 
Reference Input 



E(s) 



Controller 



U(s) + 



R 2 (s) 

Disturbance 
Input 



Control 
Action 



Plant 



C(s) 

-► 



Controlled 
Output 



Fig. 4.22 Generalized closed-loop control system. 
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4.5.2 Proportional control 



In this case, the control action, or signal is proportional to the error e(t) 

u(t) = K\e{f) 



(4.59) 



where K\ is the proportional gain constant. 

If the plant dynamics are first-order, then Figure 4.22 can be described as shown in 
Figure 4.23. The plant transfer function is 



(U(s) - R 2 (s)) 



K 



C(s) 



1 + TSy 

And the proportional control law, from equation (4.59) becomes 

U(s) = KxiR^s) - C(sj) 
Inserting equation (4.61) into equation (4.60) gives 

„,_ {*!(*! (J) -C(3))-.R 2 fr)K 

(S) ~ (1 + Ts) 

which can be written as 

{(1 + K X K) + Ts)C{s) = K x KR x {s) - KR 2 (s) 

Re-arranging equation (4.63) gives 

(t^)W-(w)W 



C(s) 



{i + (tt^>} 



(4.60) 



(4.61) 



(4.62) 



(4.63) 



(4.64) 



When r\(t) is a unit step, and r 2 (t) is zero, the final value theorem (equation (3.10)) 
gives the steady-state response 



c(i) 



1+KiK 



as t — > oo. 



R 2 (s) 
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U(s) 


-A 


r _ 






— A 
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-►Qy- —> 























Fig. 4.23 Proportional control of a first-order plant. 
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When r2(0 is a unit step, and r\(f) is zero, the final value theorem (equation (3.10)) 
gives the steady-state response 



c{t) 



K 



\+K x K 



as t 



oo. 



Hence, for the system to have zero steady-state error, the terms in equation (4.64) 
should be 



K X K 



l+K x K 

K 
l+K x K 



(4.65) 



This can only happen if the open-loop gain constant K\K is infinite. In practice this is 
not possible and therefore the proportional control system proposed in Figure 4.23 
will always produce steady-state errors. These can be minimized by keeping the open- 
loop gain constant K\K as high as possible. 

Since the closed-loop time-constant form equation (4.64) is 

I (4.66) 

Then maintaining K\K at a high value will reduce the closed-loop time constant and 
therefore improve the system transient response. 

This is illustrated in Figure 4.24 which shows a step change in r\(i) followed by a 
step change in riif). 

Summary 

For a first-order plant, proportional control will always produce steady-state errors. 
This is discussed in more detail in Chapter 6 under 'system type classification' where 
equations (6.63)-(6.65) define a set of error coefficients. Increasing the open-loop 
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Fig. 4.24 Step response of a first-order plant using proportional control. 
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gain constant (which is usually achieved by increasing the controller gain K\) will 
reduce, but not eliminate them. A high controller gain will also reduce the transient 
period. However, as will be shown in Chapters 5 and 6, high open-loop gain 
constants can result in the instability of higher- order plant transfer functions. 

4.5.3 Proportional plus Integral (PI) control 



Including a term that is a function of the integral of the error can, with the type of 
plant shown in Figure 4.23, eliminate steady-state errors. 
Consider a control law of the form 

u(t) = K x e(i) + K 2 edt (4.67) 

Taking Laplace transforms 

U(s)= (Kx+^pjEis) 

= K 1 (i+±-)e(s) (4.68) 

In equation (4.68), 7} is called the integral action time, and is formally defined as: 
The time interval in which the part of the control signal due to integral action 
increases by an amount equal to the part of the control signal due to proportional 
action when the error is unchanging'. (BS 1523). 

Inserting the PI control law given in equation (4.68) into the first-order plant 
transfer function shown in equation (4.60) gives 

r( , (*i(l + l/gjjXgifr) ~ C(s)) - R 2 (s))K ..... 

C(s) = ^^ (4.69) 

which can be written as 

{TiTs 2 + 7i(l + K { K) S + K { K}C(s) = K X K{\ + Tis)Ri(s) - KiKTisR 2 (s) (4.70) 

Re-arranging gives 

r( , {\ + T i s)R x {s)-T { sR 2 {s) 

c{s) = (tt\ ; — i — r^ — (4 - 71) 

The denominator is now in the standard second-order system form of equation 
(3.42). The steady-state response may be obtained using the final value theorem 
given in equation (3.10). 

c(t) = (1 + 0)ri(f) - (0)r 2 (0 as t -* oo (4.72) 
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Time (s) 



Fig. 4.25 Step response of a first-order plant using PI control. 
When there are step changes in r\(t) and r 2 (t): 

C(s) = (0) 

s s 

= R l (s) 

c(t) = n(t) 



(4.73) 



Thus, when r\(t) and r 2 (t) are unchanging, or have step changes, there are no steady- 
state errors as can be seen in Figure 4.25. The second-order dynamics of the closed- 
loop system depend upon the values of T u T, K\ and K. Again, a high value of K\ will 
provide a fast transient response since it increases the undamped natural frequency, 
but with higher order plant transfer functions can give rise to instability. 

Summary 

For a first-order plant, PI control will produce a second-order response. There will be 
zero steady-state errors if the reference and disturbance inputs r\(t) and r 2 (t) are 
either unchanging or have step changes. The process of including an integrator within 
the control loop to reduce or eliminate steady-state errors is discussed in more detail 
in Chapter 6 under 'system type classification'. 

Example 4.5 (See also Appendix 1, examp45.m) 

A liquid-level process control system is shown in Figure 4.26. The system parameters 

are 

A = 2m 2 7? f =15s/m 2 

H x = 1 V/m K v = 0.1 m 3 /sV K\ = 1 (controller again) 



(a) What are the values of T x and ( when the undamped natural frequency uo n is 
O.lrad/s? 

(b) Find an expression for the time response of the system when there is a step 
change of h^(t) from to 4 m. Assume zero initial conditions. 
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Fig. 4.26 Liquid-level process control system. 

The controller is given in equation (4.68). The inflow to the tank is 

v l (t) = K Y u(t) 

The tank dynamics are expressed, using equation (2.63) as 

Vl (t)- V2 (t) = A^. 



and the linearized outflow is 



v 2 (0 



Kit) 



(4.74) 



(4.75) 



(4.76) 



The measured head h m (t) is obtained from the pressure transducer 

MO = H x h a (t) (4.77) 

From equations (4.75) and (4.76), the tank and outflow valve transfer function is 



H a 



Ri 



Vi 1+ARfS 



(4.78) 



The block diagram for the control system is shown in Figure 4.27. From the block 
diagram, the forward-path transfer function G(s) is 



G(s 



KiK y R { ( 

')= „ . \ 



1+i 



(1 + ARts) 

KiK v R[(\ + T iS ) 

T iS (l + AR ( ) 



(4.79) 
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Fig. 4.27 Block diagram for liquid-level process control system. 

Using equation (4.4), the closed-loop transfer function becomes 



He 

H 



(s) 



which simplifies to 
H 



Hi 



(s) = 



KiK,Rt(l + Tjs) 

(AR r T iS 2 +Tis) 

, , KiK^RcHiiJ+Tjsl 

~T (ARfTiS 2 + T lS ) 



KiK v R f (\ + T iS ) 



(4.80) 



(AR { Tjs 2 + 7i(l + KiK v R{Hi)s + K { K v R { Hi 



(4.81) 



Equation (4.81) can be expressed in the standard form of equation (3.42) for a 
second-order system. 
Putting Hi = 1, then 



H, 



-(s) 



(1 + 7ij) 



(4.82) 



(a) Comparing the denominator terms with the standard form given in equation (3.42) 

(4.83) 



7i 



AT, 
K\K W 

1 



1 



^- 



ll-^C 



From equation (4.83) 



T { 



K X K V _ 1 x 0.1 
cj^ ~0.1 2 x2 



^n 



5 seconds 



(4.84) 



From equation (4.84) 



c = 



2 Ui^v^f 

0.1x5/ 1 



1 xO.l x 15 



0.417 
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(b) Inserting values into equation (4.82) 



*•(,) = <I±*2 (4 85) 

H d {) 1005 2 + 8.345+1 { ' 



For a step input of height 4 m 

0.01(1+5^) 



HM 



s 2 + 0.0834^ + 0.01 
Expanding by partial fractions using 3.2.4 (iv) 

H °"° 4 + 02S = - BS + C 

&{S) ~ s(s 2 + 0.08345 + 0.01) ~ s s 2 + 0.08345 + 0.01 ( ' ' 

Multiplying through by s(s 2 + 0.08345 + 0.01) 

0.04 + 0.25 = A(s 2 + 0.08345 + 0.01) + Bs 2 + Cs 

Equating coefficients 



(* 2 ): 


= A + B 


(*'): 


0.2 = 0.0834.4 + C 


(s°): 


0.04 = 0.01,4 



giving 

A = 4 B=-4 C = -0.1336 
Substituting values back into (4.86) and complete the square to give 

4 -4^- 0.1336 

~s (<? + 0.0417) 2 + 0.0909 2 



H *(*) = z + ; ^2 o ( 4 - 87 ) 



Inverse transform using Laplace transform pairs (9) and (10) in Table 3.1. 
4 f 4s 1 f 0.0909 



#a0) 



}-,.46, 7 {- 



5 l(5 + 0.0417) 2 + 0.0909 2 J l(5 + 0.0417) 2 + 0.0909 2 



/, a (r) = 4-4e-° 0417 '( cos 0.0909? -?^S sin 0.0909/ 
- 1.4697e- 00417 ' sin 0.0909/ 
which simplifies to give 

h a (t) = 4[1 - e-° 0417 '( cos 0.0909/ - 0.0913 sin 0.0909/)] (4.88) 
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Fig. 4.28 Response of the PI controlled liquid-level system shown in Figure 4.26 to a step change in h^(t) 
from 0to4m. 



In equation (4.88) the amplitude of the sine term is small, compared with the cosine 
term, and can be ignored. Hence 



K(t) = 4(1 - e-°- 0417r cos 0.0909^) 
The time response depicted by equation (4.89) is shown in Figure 4.28. 



(4.89) 



4.5.4 Proportional plus Integral plus Derivative (PID) control 

Most commercial controllers provide full PID (also called three-term) control action. 
Including a term that is a function of the derivative of the error can, with high-order 
plants, provide a stable control solution. 

Proportional plus Integral plus Derivative control action is expressed as 



u(t) = K\e(t) + K 2 edt + K 3 



/• 



de 
dt 



(4.90) 



Taking Laplace transforms 



K 2 



U(s)= (K l +'-j + K 3 s)E(s) 
= *■( ]+±-+T d s}E(.s) 



(4.91) 
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In equation (4.91), T& is called the derivative action time, and is formally defined as: 
'The time interval in which the part of the control signal due to proportional action 
increases by an amount equal to the part of the control signal due to derivative action 
when the error is changing at a constant rate' (BS 1523). 
Equation (4.91) can also be expressed as 



^(7^ + 7.,+ D 
71s 



(4.92) 



4.5.5 The Ziegler-Nichols methods for tuning PID controllers 

The selection of the PID controller parameters K\ , T x and 7^ can be obtained using 
the classical control system design techniques described in Chapters 5 and 6. In the 
1940s, when such tools were just being developed, Ziegler and Nichols (1942) devised 
two empirical methods for obtaining the controller parameters. These methods are 
still in use. 

(a) The Process Reaction Method: This is based on the assumption that the open- 
loop step response of most process control systems has an S-shape, called the process 
reaction curve, as shown in Figure 4.29. The process reaction curve may be approxi- 
mated to a time delay D (also called a transportation lag) and a first-order system of 
maximum tangential slope R as shown in Figure 4.29 (see also Figure 3.13). 

The Process Reaction Method assumes that the optimum response for the closed- 
loop system occurs when the ratio of successive peaks, as defined by equation (3.71), 
is 4:1. From equation (3.71) it can be seen that this occurs when the closed-loop 
damping ratio has a value of 0.21. The controller parameters, as a function of R and 
D, to produce this response, are given in Table 4.2. 




Fig. 4.29 Process reaction curve. 
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Table 4.2 Ziegler-Nichols PID parameters using the 
Process Reaction Method 



Controller type 


Ki 


T { T d 


P 

PI 

PID 


XIRD 

0.9/RD 

X.2IRD 


D/03 

2D 0.5D 


Table 4.3 Ziegler-Nichols PID 
Continuous Cycling Method 


parameters using the 


Controller type 


K x 


Ti T d 


P 

PI 

PID 


KJ2 

KJ2.2 

KJX.l 


TJX. 2 

TJ2 r u /8 



Note that the Process Reaction Method cannot be used if the open-loop step 
response has an overshoot, or contains a pure integrator (s). 

(b) The Continuous Cycling Method: This is a closed-loop technique whereby, 
using proportional control only, the controller gain K\ is increased until the system 
controlled output c(t) oscillates continually at constant amplitude, like a second- 
order system with no damping. This condition is referred to as marginal stability 
and is discussed further in Chapters 5 and 6. This value of controller gain is called 
the ultimate gain K u , and the time period for one oscillation of c(t) is called the 
ultimate period T u . The controller parameters, as a function of K u and T u , to provide 
a similar closed-loop response to the Process Reaction Method, are given in 
Table 4.3. 

The two Ziegler-Nichols PID tuning methods provide a useful 'rule of thumb' 
empirical approach. The control system design techniques discussed in Chapters 5 
and 6 however will generally yield better design solutions. 

Of the two techniques, the Process Reaction Method is the easiest and least 
disruptive to implement. In practice, the measurement of R and D is very subjective, 
and can lead to errors. 

The Continuous Cycling Method, although more disruptive, has the potential to 
give better results. There is the risk however, particularly with high performance 
servo-mechanisms, that if K u is increased by accident to slightly above the marginal 
stability value, then full instability can occur, resulting in damage to the system. 

Actuator saturation and integral wind-up 

One of the practical problems of implementing PID control is that of actuator 
saturation and integral wind-up. Since the range of movement in say, a control valve, 
has physical limits, once it has saturated, increasing the magnitude of the control 
signal further has no effect. However, if there is a difference between desired and 
measured values, the resulting error will cause a continuing increase in the integral 
term, referred to as integral wind-up. When the error term changes its sign, the 
integral term starts to 'unwind,' and this can cause long time delays and possible 
instability. The solution is to limit the maximum value that the integral term 
can have. 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC04.3D - 92 - [63-109/47] 9.8.2001 2:28PM 



92 Advanced Control Engineering 

4.5.6 Proportional plus Derivative (PD) control 

Proportional plus Derivative control action is expressed as 



u(t) = K l e(t) + K 3 ( ^ (4.93) 

dt 



^)=^,ii+JW) 



Taking Laplace transforms 



= K x (\ + T d s)E(s) (4.94) 

The inclusion of a derivative term in the controller generally gives improved damping 
and stability. This is discussed in more detail in Chapters 5 and 6. 



4.6 Case study examples 

Example 4.6.1 CNC Machine-Tool Positional Control (See also Appendix 1, 
examp461.m) 

The physical configuration and block diagram representation of a CNC machine- 
tool is shown in Figures 1.10 and 1.11. The fundamental control problem here is that, 
by design, the lead-screw (by the use of re-circulating ball-bearings) is friction-free. 
This means that the positional control system will have no damping, and will oscillate 
continuously at the undamped natural frequency of the closed-loop system. 
Damping can be introduced in a number of ways: 

(a) A dashpot attached to the lead-screw. This is wasteful on energy and defeats the 
objective of a friction-free system. 

(b) Velocity feedback: A signal from a sensor that is the first derivative of the 
output (i.e. velocity) will produce a damping term in the closed-loop transfer 
function. 

(c) PD control. A PD controller will also provide a damping term. However, the 
practical realization will require an additional filter to remove unwanted high 
frequency noise (see Chapter 6 for further details on lead-lag compensation). 

Most machine-tool manufacturers employ velocity feedback to obtain the necessary 
damping. Since overshoot in a cutting operation usually cannot be tolerated, the 
damping coefficient for the system must be unity, or greater. 

For this study, the machine-tool configuration will be essentially the same as 
shown in Figure 1.10, with the exception that: 

(i) A gearbox will be placed between the servo-motor and the lead-screw to provide 
additional torque. 

(ii) The machine table movement will be measured by a linear displacement trans- 
ducer attached to the table. This has the advantage of bringing the table 'within 
the control-loop' and hence providing more accurate control. 
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System element dynamic equations: With reference to Figures 1.11 and 4.31 
1. Controller 



2. Power amplifier 



Proportional control, gain K\(V/m) 
Control signal U\(s) = K x (X d (s) - X m (s)) 



Gain K 2 (Y/Y) 

Control signal U 2 (s) = K 2 {U l (s) - B 2 (s)) 



(4.95) 



(4.96) 



3. DC servo-motor: Field controlled, with transfer function as shown in Figure 4.17. 
It will be assumed that the field time constant Lf/Rf is small compared with the 
dynamics of the machine table, and therefore can be ignored. Hence, DC servo- 
motor gain K?, (Nm/V). 



Motor Torque T m (s) = K 3 U 2 (s) 



(4.97) 



4. Gearbox, lead-screw and machine- table: With reference to Figure 2.9 (free-body 
diagram of a gearbox), the motor-shaft will have zero viscous friction C m , hence 
equation (2.22), using Laplace notation, becomes 



X(s) = -(T m (s)-I m s 2 m (s)) 



(4.98) 



The output shaft in this case is the lead screw, which is assumed to have zero moment 
of inertia I and viscous friction C . The free-body diagrams of the machine-table 
and lead-screw are shown in Figure 4.30. 
For lead-screw 

Work in = Work out 

bX(t)0 o (t) = F(t)x (t) 



or 



F(t) = bX(t) 



0o(Q 

X (t) 



(4.99) 



bX(t) 



X (t), X (t), Xo(t) 




JL 



KvW^WKW^ ^\VXW\V^N 



Fig. 4.30 Free-body diagrams of lead-screw and machine-table. 
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Now the pitch p of the lead-screw is 



>-m (4100) 

Substituting (4.100) into (4.99) 

F(t) = b ^ (4.101) 

P 

The equation of motion for the machine-table is 

F(t) = mx (4.102) 

Equating (4.101) and (4.102) gives 

^(0 = T(pmx ) 



Taking Laplace transforms 



X(s) = \ (pms 2 X (s)) (4. 103) 



Equating (4.98) and (4.103) gives 



Now 

Hence 

and 



pms 2 X (s) = - (T m (s) - lms 2 m (s)) (4. 104) 



bla = gear ratio n 
m (s) = n0 o (s) 



P 
Equation (4.105) can be substituted into (4.104) 

o2 



s z m (s) = ns z o (s) 



o(s)=^- (4.105) 



pms z X (s) = nT m (s) - nI m -s 2 X (s) 

P 

or 

nT m (s) = (pm + — ) s 2 X (s) (4. 106) 

giving the transfer function for the gearbox, lead-screw and machine-table as 

T m {pm + n 2 I m /p)s 2 

where the term n 2 I m / P may be considered to be equivalent mass of I m referred to the 
machine- table. 
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5. Tachogenerator 



Gain # 2 (Vs/rad) 
Feedback signal B 2 (s) = H2s0 o (s) 



or, from equation (4.105) 



B 2 (s) = ^sX (s) 

P 



(4.108) 



(4.109) 



6. Position transducer 



Gain #i(V/m) 
Feedback signal X m (s) = H\X {s) 



(4.110) 



The system element dynamic equations can now be combined in the block diagram 
shown in Figure 4.31. Using equation (4.4), the inner-loop transfer function is 



G(s) 



K 2 K 3 np 



(p 2 m + n 2 I m )s + K 2 K 3 nH 2 
Again, using equation (4.4), the overall closed-loop transfer function becomes 



(4.111) 



X 



{*) 



K\K 2 K 3 np 



X d (p 2 m + n 2 I m )s 2 + K 2 K 3 nH 2 s + K x K 2 K 3 npH x 

which can be written in standard form 



-0) 



j_ 

Hi 



X d ( ?mWl m \ 2 , (.J^j + 1 

\K x K 2 K 3 npH x )* ^ \KypHyJ* ^ l 



(4.112) 



(4.113) 



X ^W-> 



X m (s) 



Power DC 

Controller Amplifier Servomotor 

<4 < s ) . , U»(s) , , r m (s) 



Machine 
Table Integrator 

sX (s) 



Ki 




B 2 (s) 



Tachogenerator 

s9 (s) 



H 2 



Hi 



Position Transducer 
Fig. 4.31 Block diagram of CNC machine-tool control system. 
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Specification: The CNC machine- table control system is to be critically damped with 
a settling time of 0.1 seconds. 

Control problem: To select the controller gain K\ to achieve the settling time and 
tachogenerator constant to provide critical damping. 

System parameters 

K 2 = 2Y/Y ^ 3 =4Nm/V 
?z=10:l ^ = 5xl0" 3 m 

m = 50 kg I m = 10 x 10~ 6 kgm 2 
H x =60V/m 

Calculation of K\ : In general, the settling time of a system with critical damping is 
equal to the periodic time of the undamped system, as can be seen in Figure 3.19. 
This can be demonstrated using equation (3.62) for critical damping 

x o (0 = [l-e-^(l+Wn0] 
when 

t = 2it/uo n 

x (t) = [1 - e- 2 ^(l + 2tt)] 

= 0.986 (4.114) 

Thus, for a settling time of 0.1 seconds for a system that is critically damped, the 
undamped natural frequency is 

u, n =^- = 62.84 rad/s (4.115) 

Comparing the closed-loop transfer function given in equation (4.113) with the 
standard form given in (3.42) 

2 (K x K 2 K i npH l \ 



<={-m^) (4U6) 



Hence 



(p 2 m + n 2 I m )ul 
K] — 



K 2 K z npH x 
{(5 x 10- 3 ) 2 x 50} + (10 2 x 10 x 10- 6 )' 



x 62.84 2 



(2 x 4 x 10 x 5 x 10- 3 x 60) 
= 0.365 V/V (4.117) 

Again, comparing equation (4.113) with the standard form (3.42) 

2C H 2 



u; n KipH] 



(4.118) 
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2 x 1 x 0.365 x 5 x KT 3 x 60 



62.84 
= 3.485 x 10~ 3 Vs/rad (4.119) 

Example 4.6.2 Temperature control system (See also Appendix 1, examp462.m) 
The general form of a temperature control system is shown in Figure 1.6 with the 
corresponding block diagram given in Figure 1.7. 
The system variables are: 

#d(0 = Desired temperature (°C) 

6 m (t) = Measured temperature (V) 

O (0 = Actual temperature (°C) 

6 s (t) = Temperature of surroundings (°C) 

u(t) = Control signal (v) 

v(t) = Gas flow-rate (m 3 /s) 
Qi(t) = Heat flow into room (J/s = W) 
Q (t) = Heat flow though walls (W) 

System equations 

1. Controller: The control action is PID of the form given in equation (4.91) 

U(s) = K x (l + i- + T d s\ (0 d (s) - m (s)) (4.120) 

2. G<2^ solenoid valve: This is assumed to have first-order dynamics of the form 

V K 2 

— (s) = — (4.121) 

U KJ 1 + Tis K ) 

where K 2 is the valve constant (m 3 /s V). 

3. Gas burner: This converts gas flow-rate v(t) into heat flow Q[(t) i.e.: 

Q l (s) = K 3 V(s) (4.122) 

where K$ is the burner constant (Ws/m 3 ). 

4. Room dynamics: The thermal dynamics of the room are 

dO 
Qi(t)-Q (t) = C T -£ (4.123) 

Equation (4.123) is similar to equation (2.54), where C T is the thermal capacitance 
of the air in the room. 
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The heat flow through the walls of the building is as given in equation (2.53), i.e. 

(9 (t) - 0,(0) 



Q (t) 



Rj 



where Rj is the thermal resistance of the walls, see equation (2.47). 
Substituting equation (4.124) into (4.123) gives 



(4.124) 



(4.125) 



Multiplying through by Rj 



RrQiit) + s (t) = O (O + R T C T 



d0o 
At 



(4.126) 
(4.127) 



Taking Laplace transforms 

RiQAs) + e s (s) = (1 + R T C T s)e o (s) 
Equation (4.127) can be represented in block diagram form as shown in Figure 4.32. 
5. Thermometer. The thermometer equation is 

e m {s) = H l e (s) (4.128) 

The complete block diagram of the temperature control system is shown in Figure 

4.33. 

From Figure 4.33 



KiKjKiRTJTjTts 2 + T iS + l)(fl d (j) - H x 9 (s)) 
TAX + T lS ) 



9 s (s) = (1 + R T C T s)9 (s) (4.129) 



Bs(s) 











L+ 




1 




Qi(s) 


At 


e Q (s) 




► 


vv 


► 


1+RtCtS 


► 









Fig. 4.32 Block diagram representation of the thermal dynamics of the room. 



PID Controller 



Valve Burner 



Us) X - 



«[ 1+ i +T - s ] 


U(s) 

— ► 


K 2 

"l + TiS 






V{S) 

— ► 


K 3 


► 


Rt 







s (s) 



Room 



~~^S)~ * 1+RjCrS 



H, 



(s) 



*-► 



Fig. 4.33 Block diagram of temperature control system. 
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Equation (4.129) can be re-arranged to give 



$ (s) = -. ^- 7 -^ ^ r^L (4 . 1 30) 

{msty + (W+ T ^Y + H^ + l ) s+ 1 

where the forward-path gain K? is 

K F = K l K 2 K 3 R T (4.131) 

Control problem: Given the system parameters, the control problem is to determine 
the controller settings for K\ 9 T x and 7^. This will be undertaken using the Zeigler- 
Nichols process reaction method described in Section 4.5.5(a). 

System parameters: 

K 2 K 3 = 5 W/V R T = 0. 1 Ks/J 
C T = 80J/K 77i = 1.0V/K 
T\ = 4 seconds 

Process reaction curve: This can be obtained from the forward-path transfer function 

0o, x K 2 K 3 Rt 

U (1 + 7V)(1 + 7? T C T s) 

Inserting values into equation (4.132) gives 

£ ( ' ) = (1 + 4^1 + 8,) (4 - 133) 

Figure 4.34 shows the response to a unit step, or the process reaction curve. 

From the R and D values obtained from the process reaction curve, using the 
Zeigler-Nichols PID controller settings given in Table 4.2 

K x = 1 .2/ RD = 26.144 
T{ = 27) = 3.0 seconds 
7d = 0.57) = 0.75 seconds 

Assuming that the temperature of the surroundings s (t) remains constant, the 
closed-loop transfer function (using equation (4.130)) for the temperature control 
system, is 

°J>f s) = ( 2 ^ 2 + 3, + l) ( 4 134) 

<9 d V ; 7.344s 3 + 5.004s 2 + 3.229s +1 y ' J 

The response to a step change in the desired temperature of 0-20 °C for the closed- 
loop transfer function given by equation (4.134) is shown in Figure 4.35. 
From Figure 4.35, the ratio of successive peaks is 
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Fig. 4.34 Process reaction curve for the temperature control system shown in Figure 4.33. 
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Fig. 4.35 Closed-loop step response of temperature control system using PID controller tuned using 
Zeigler— Nichols process reaction method. 



This corresponds to a damping ratio of 0.23. These values are very close to the 
Zeigler-Nichols optimum values of 4.0 and 0.21 respectively. 

Example 4.6.3 Ship Autopilot (See also Appendix 1, examp463.m) 
A ship has six degrees-of-freedom, i.e. it is free to move in six directions simultan- 
eously, namely three linear motions - surge (forward), sway (lateral) and heave 
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(vertical) together with three rotational motions - roll, pitch and yaw. This analysis 
considers rotation about the yaw axis (i.e. heading control) only. 

Figure 1.12 shows a typical ship autopilot system and Figure 1.13 shows the 
corresponding block diagram. Rotation about the yaw axis is in effect rotation about 
the z, or vertical axis of the vessel, called the V direction since r is the symbol for 
yaw-rate. Hence hydrodynamic coefficients for the yaw axis are therefore given the 
subscript V. Yaw hydrodynamic coefficients are given the symbol W. In this 
analysis the dynamics of the steering gear are neglected. 

The system variables are 

^d(0 = Desired heading (radians) 

\£ a (0 = Actual heading (radians) 

6(t) = Rudder angle (radians) 

Figure 4.36 shows the hull free-body diagram. Disturbance effects (wind, waves and 
current) are not included. 

System equations 

1. Hull dynamics: In Figure 4.36, X Y is the earth co-ordinate system where X is 
aligned to north. All angles are measured with respect to X . A consistent right- 
hand system of co-ordinates is used, with the exception of the rudder-angle, which 
has been selected to be left-hand to avoid negative coefficients in the hull transfer 
function. 



Actual Course 



Ut) VM 



Desired Course 




Fig. 4.36 Free-body diagram of ship hull dynamics. 
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From Figure 4.36 the equation of motion for the yaw axis is 

Y J M G = I z ^(t) 

(N 6 6(t)) - (JVr^a(O) = W0 

Taking Laplace transforms 

N 6 6(s) = (I z s 2 + N r s)^(s) 
Hence the hull transfer function becomes 

^a n= N s 

6 {S) s(I z s + N r ) 



(4.136) 



(4.137) 



(4.138) 



2. Control action: In this case, the autopilot (controller) is considered to provide 
proportional control only. 



6(s) = K { (Ms) ~ ^(s)) 



(4.139) 



3. Gyro-compass: This provides a measured heading proportional to the actual 
heading 



ip m (s) = Hiip^s) 



(4.140) 



Combining equations (4.138), (4.139) and (4.140) produces the block diagram shown 

in Figure 4.37. 

Using equation (4.4), the closed-loop transfer function is 



^a 
^d 



(s) 



Equation (4.141) simplifies to give 



~(s) 



K X K 2 N 8 
s{I z s+N r ) 
■ K X K 2 N 6 H X 

"•" s(I z s+N r ) 



J_ 
Hi 



^d ( h ^ ^2 , ( N, ^ s . 



(4.141) 



(4.142) 
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Fig. 4.37 Block diagram of ship autopilot control system. 
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Equation (4.142) is in the standard form given in equation (3.42). 

Control problem: For a specific hull, the control problem is to determine the autopilot 
setting (K\ ) to provide a satisfactory transient response. In this case, this will be when 
the damping ratio has a value of 0.5. Also to be determined are the rise time, settling 
time and percentage overshoot. 

System parameters: The ship to be controlled is a cargo vessel of length 161m with a 
MARINER type hull of total displacement 17 000 tonnes. 

K 2 = 1 .0 rad/V N s = 80 x 10 6 Nm/rad 

N r = 2 x 10 9 Nms/rad I z = 20 x 10 9 kgm 2 
H x = l.OV/rad 

Inserting values into equation (4.142) gives 

— (*) = t x \ x (4.143) 

lfj d ( 20x109 2 , ( 2xlQ9 \ , j 

^ixSOxlO 6 ^ ~ ^ixSOxlO 6 ^ ~ x 



which simplifies to 



— (J) = 7-^ V^ ( 4 - 144 ) 

1 



^ (f)^ 2 +(i)- 



Comparing equation (4.144) with the standard form given in equation (3.42) 

1 250 









<4 


Kx 


and 








25 


Given that ( 


= 0.5, 


then from equation (4.146) 










K\ 








ui a -- 


"25 


Substituting 


(4.147) 


into (4.145) 


gives 

25 2 


250 


Hence 
















K 625 ' 
* 1= 250 = - 


and from equation (4.147), 












2.5 
" n= 2T 


= 0.1i 



(4.145) 



(4.146) 



(4.147) 



2.5 (4.148) 



(4.149) 
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Fig. 4.38 Unit step response of ship autopilot control system. RiseTime (to 95%) = 23 seconds; 

Percentage Overshoot = 16.3%; 
Settling time (to ±2%) = 81 seconds. 



From equations (3.58) and (3.59) the unit step response for the ship autopilot control 
system is given by the expression 

-0.05*/ 



^ a (0 = 1 -e~ UUDr ( cos 0.0866^ + 0.577 sin 0.08660 
Figure 4.38 shows the system unit step response. From Figure 4.38 



(4.150) 



4.7 Further problems 

Example 4.7 

For the block diagrams shown in Figure 4.39 find an expression for the complete 

output when all inputs act simultaneously. 

Solutions 

_ (G l (s)G 2 (s)G 3 (s))R l (s) + G 3 (s)(l + G 2 (s)H 3 (s))R 2 (s) 
W C W ~ 1 + G 3 (s)H 2 (s) + G 2 (s)H 3 (s) + Gi(s)G2(s)G 3 (s)Hi(s) 



(b) C(s). 



(G l (s)G 2 (s)G 3 (s)G 4 (sy)R l (s) - (G^G^G^GijsW^R^s) - (G 3 (s)G 4 (s))R 3 (s) 
l + G 3 (s)H 2 (s) + G { (s)G 2 (s)G 3 (s)G 4 (s)H { (s) 



Example 4.8 

The speed control system shown in Figure 4.40 consists of an amplifier, a field- 
controlled DC servomotor and a tachogenerator. The load consists of a mass of 
moment of inertia / and a fluid damper C. The system parameters are: 

/ = 0.75 kg m 2 C = 0.5Nms/rad 
K 2 = 5 Nm/A H { =0.\ Vs/rad 
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► G 2 



(b) 



Fig. 4.39 Block diagrams for closed-loop systems. 



► G 3 



H 2 < 



► G 4 — f-> 



<8h- 



Amplifier 



l a = constant 




Tachogenetator 
)- l H, 



Fig. 4.40 Speed control system. 



Find the value of K\ to give the system a closed-loop time constant of one second. 
What is the steady-state value of w (t) when V[(t) has a value of 10 V. 

Solution 

0.5 A/V 
33.3rad/s 
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Error 
Detector 




Hi 

Tachogenerator 



Fig. 4.41 Angular positional control system. K-\ = Error detector gain (V/rad); K 2 = Amplifier gain (A/V); 
K 3 - Motor constant (Nm/A); n = Gear ratio; H<\ - Tachogenerator constant (Vs/rad); l - Load moment 
of inertia (kg m 2 ); C = Load damping coefficient (Nms/rad). 

Example 4.9 

Find an expression for the closed-loop transfer function relating 0[(s) and o (s) for 

the angular positional control system shown in Figure 4.41. 



Solution 



/ \ 



1 



{k^k^J 3 



( C Q +K 2 K ?> n 2 H x 
\ KxK 2 K 3 n 



Example 4.10 

A hydraulic servomechanism consists of the spool-valve/actuator arrangement 
shown in Figure 4.19 together with a 'walking beam' feedback linkage as shown in 
Figure 4.42. The spool-valve displacement x v (t) is given by the relationship 



J 


k 




— w 
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Xy(f) 
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i 
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Hydraulic Actuator 






* 








* 
















^o(t) 





Fig. 4.42 Hydraulic servomechanism with 'walking beam' feedback linkage. 
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Fig. 4.43 Block diagram of a servomechanism. 



x v (0 



<2 + Z? 



Xi(0 



x o (0 



If the forward-path transfer function is given by equation (4.57), find an expression for 
the closed-loop transfer function relating X[(s) and X (s). The system parameters are 



m = 50 kg 
A = 0.01m 2 

C p = 6x 10- 9 m 5 /Ns a = b = 0.15m 



V t = 4x 10- 3 m 3 /3= 1.4 GPa 

^ q = 10.0 m 2 /s K c = 6x 10- 9 m 5 /Ns 



Solution 



Xo_ 

X, 



(s) 



500 



0.357 x 10- 6 j 3 + 0.12 x 10- 3 ^ 2 + s + 500 



Example 4.11 

A servomechanism consists of an amplifier, actuator and sensor as shown in block 

diagram form in Figure 4.43. If the input to the system is a constant velocity of the 

form 

0i(O = It 

find an expression for the time response of the system. 

Solution 

o (t) = 0.667 1 - 0.0222 + e -'(0.0222 cos 7.68; - 0.083 sin 7.680 



Example 4.12 

Figure 4.44 shows the elements of a closed-loop temperature control system. A 
proportional controller compares the desired value 0[(t) with the measured value 
v o (0 and provides a control signal u(t) of K\ times their difference to actuate the valve 
and burner unit. The heat input to the oven Qi(i) is K2 times the control signal. 
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Fig. 4.44 Closed-loop temperature control system. 

The walls of the oven have a thermal resistance Rj and the oven has a thermal 
capacitance C T and operating temperature o (t). The heat transfer equation for the 
oven may be written 

a (a e o(t)_ r d0 o 

The thermometer and measurement system feed a measured value of H\ times o (t) to 
the controller. The system parameters are 

Ki = 5 K 2 = 1.5 J/V 7/i = 1 V/K 

#r = 2K/J C T = 25Js/W 



Find 

(a) The open-loop time constant 

(b) The closed-loop time constant 

(c) The percentage steady-state error in the output when the desired value is con- 
stant. 

Solution 

(a) 50 seconds 

(b) 3.125 seconds 

(c) 6.25% 

Example 4.13 

Figure 4.45 shows the block diagram representation of a process plant being con- 
trolled by a PID controller. 

(a) Find an expression for the complete response C(s) when R\(s) and R2(s) act 
simultaneously. 

(b) Using the Ziegler-Nichols Process Reaction Method, determine values for K\ , T{ 
and 7d when T\ = 10 seconds and 7^ = 20 seconds. 
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Fig. 4.45 Process plant under PID control. 
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(c) Insert the values into the expression found in (a). Using MATLAB, or otherwise, 
determine the response c(t) when r\(f) is a unit step and r2(t) is zero. What is the 
ratio of successive peaks? 



Solution 
(a) C(s) 



KijTiTjS 2 + T iS + l)fli(s) + TjsR 2 (s) 
T(T X T 2 s 3 + TSJ X + T 2 +K X r d )s 2 + 7-(l + K x )s + K x 

(b) K\ = 17.2 7j = 6 seconds T^ = 1.5 seconds 

17.2(9s 2 + 6s+l) 



(c) C(s) = 



s(l200s 3 + 334.8s 2 + 109.2s + 17.2) 

2.75 
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Classical design in the 
s-plane 



5.1 Stability of dynamic systems 

The response of a linear system to a stimulus has two components: 

(a) steady-state terms which are directly related to the input 

(b) transient terms which are either exponential, or oscillatory with an envelope of 
exponential form. 

If the exponential terms decay as time increases, then the system is said to be stable. If 
the exponential terms increase with increasing time, the system is considered unstable. 
Examples of stable and unstable systems are shown in Figure 5.1. The motions 
shown in Figure 5.1 are given graphically in Figure 5.2. (Note that (b) in Figure 
5.2 does not represent (b) in Figure 5.1.) The time responses shown in Figure 5.2 can 
be expressed mathematically as: 
For (a) (Stable) 



For (b) (Unstable) 
For (c) (Stable) 
For (d) (Unstable) 



x (t) = AQ~ at sin(u;t + 0) (5.1) 

x o (0 = Ae at sm(ut + 0) (5.2) 

x (t) = AQ- at (5.3) 

x (t) = Ae at (5.4) 



From equations (5.1)— (5.4), it can be seen that the stability of a dynamic system 
depends upon the sign of the exponential index in the time response function, which 
is in fact a real root of the characteristic equation as explained in section 5.1.1. 
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Fig. 5.1 Stable and unstable systems. 
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Xo(t) 
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Fig. 5.2 Graphical representation of stable and unstable time responses. 
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5.1.1 Stability and roots of the characteristic equation 

The characteristic equation was defined in section 3.6.2 for a second-order system as 

as 2 +bs + c = (5.5) 

The roots of the characteristic equation given in equation (5.5) were shown in section 
3.6.2. to be 



-b ± y/b 1 - 4ac 

s u s 2 = r (5.6) 

2a 

These roots determine the transient response of the system and for a second-order 
system can be written as 

(a) Overdamping 



(b) Critical damping 



(c) Underdamping 



S\ = — G\ 

(5.7) 

S 2 = -cr 2 



s\ = s 2 = — & (5.8) 



s u s 2 = -a±ju (5.9) 

If the coefficient b in equation (5.5) were to be negative, then the roots would be 

S\ 9 ^2 = J cCF±)UJ (5.10) 

The roots given in equation (5.9) provide a stable response of the form given in 
Figure 5.2(a) and equation (5.1), whereas the roots in equation (5.10) give an 
unstable response as represented by Figure 5.2(b) and equation (5.2). 

The only difference between the roots given in equation (5.9) and those in equation 
(5.10) is the sign of the real part. If the real part a is negative then the system is stable, 
but if it is positive, the system will be unstable. This holds true for systems of any 
order, so in general it can be stated: 'If any of the roots of the characteristic equation 
have positive real parts, then the system will be unstable'. 

5.2 The Routh-Hurwitz stability criterion 

The work of Routh (1905) and Hurwitz (1875) gives a method of indicating the 
presence and number of unstable roots, but not their value. Consider the character- 
istic equation 

a n s n + a n -\s n ~ x + h a\s + a$ = (5.11) 
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The Routh-Hurwitz stability criterion states: 



(a) For there to be no roots with positive real parts then there is a necessary, but not 
sufficient, condition that all coefficients in the characteristic equation have the 
same sign and that none are zero. 

If (a) above is satisfied, then the necessary and sufficient condition for stability is either 

(b) all the Hurwitz determinants of the polynomial are positive, or alternatively 

(c) all coefficients of the first column of Routh's array have the same sign. The 
number of sign changes indicate the number of unstable roots. 

The Hurwitz determinants are 



D, 



Di = a x D 2 



Cl\ 


as 


as 




a 


a 2 


^4 


D 4 = 




Cl\ 


a 3 





a\ a 3 
a a 2 

a\ #3 a$ a-j 

#o a 2 a\ #6 

a\ a^ as 

a 2 a 4 



etc. 



(5.12) 



Routh's array can be written in the form shown in Figure 5.3. 
In Routh's array Figure 5.3 



1 



c\ 



1 



a n -\ a n _s 

&n &n—2 

b\ b 2 

a n -\ a n s 



b 2 = 



1 



c 2 



a n -\ 
1 



a n a n -4 



b\ b 3 
a n -\ a n s 



etc. 



etc. 



(5.13) 



(5.14) 



Routh's method is easy to apply and is usually used in preference to the Hurwitz 
technique. Note that the array can also be expressed in the reverse order, commen- 
cing with row s n . 



s° 


P^ 






s 1 


<h 






,n-3 


Ci 


c 2 


^3 


S-2 


th 


b 2 


^3 


,n-1 


&n-\ 


&n-3 


dn-5 


; " 


a n 


dn-2 


a n -4 



Fig. 5.3 Routh's array. 
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Example 5.1 (See also Appendix 1, A1.5) 

Check the stability of the system which has the following characteristic equation 



■2s 5 



As + 2 = 



(5.15) 



Test 1: All coefficients are present and have the same sign. Proceed to Test 2, i.e. 
Routh's array 



(5.16) 



The bottom two rows of the array in (5.16) are obtained from the characteristic 
equation. The remaining coefficients are given by 



1 

2 


2 4 
1 1 


1 
2 


2 
1 2 



1 



(2-4) = -l 



(4-0) 



c\ 



-l(-4-4) 



c 2 = 



-1 



1 



r (16-0) = 2 



(5.17) 

(5.18) 
(5.19) 
(5.20) 
(5.21) 

(5.22) 



In the array given in (5.16) there are two sign changes in the column therefore there 
are two roots with positive real parts. Hence the system is unstable. 

5.2.1 Maximum value of the open-loop gain constant for the 
stability of a closed-loop system 



The closed-loop transfer function for a control system is given by equation (4.4) 



(s) 



G(s) 



1 + G(s)H(s) 



(5.23) 



In general, the characteristic equation is most easily formed by equating the denomi- 
nator of the transfer function to zero. Hence, from equation (5.23), the characteristic 
equation for a closed-loop control system is 



1 + G(s)H(s) = 



(5.24) 
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Fig. 5.4 Closed-loop control system. 

Example 5.2 (See also Appendix 1, examp52.m) 

Find the value of the proportional controller gain K\ to make the control system 

shown in Figure 5.4 just unstable. 

Solution 

The open-loop transfer function is 



G(s)H(s) 
The open-loop gain constant is 



8i^i 



giving 



G(s)H(s) 



s(s 2 + s + 2) 

a: 



sO 2 + j + 2) 

From equation (5.24) the characteristic equation is 

K 



1 



s(s 2 + s + 2) 







or 



which can be expressed as 



s(s 2 + s + 2) + ^ = 



s 3 + s 2 + 2s + ^ = 



(5.25) 



(5.26) 



(5.27) 



(5.28) 



(5.29) 



(5.30) 



The characteristic equation can also be found from the closed-loop transfer function. 
Using equation (4.4) 



C 



(s) 



G(s) 



R y/ 1 + G(s)H(s) 

Given the open-loop transfer function in equation (5.27), where H(s) is unity, then 

C 



K 



R 



0) 



1 



s{s 2 +s+2) 
K 
' s{s 2 +s+2) 



(5.31) 
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Multiplying numerator and denominator by s(s 2 

c ^ K 



-2) 



R 



(s) 



s(s 2 + s + 2) + K 
K 



Equating the denominator of the closed-loop transfer function to zero 



s 3 + s 2 + 2s + K = 



(5.32) 
(5.33) 

(5.34) 



Equations (5.30) and (5.34) are identical, and both are the characteristic equation. It 
will be noted that all terms are present and have the same sign (Routh's first 
condition). Proceeding straight to Routh's array 



(5.35) 



K 






(2- 


K) 




1 




K 


1 




2 



where 



n 



1 K 

1 2 



(2-K) 



(5.36) 



b 2 = 
d=K 

To produce a sign change in the first column, 

K>2 

Hence, from equation (5.26), to make the system just unstable 

K x = 0.25 

Inserting (5.36) into (5.30) gives 

s 3 + s 2 + 2s + 2 = 

factorizing gives 

C? 2 + 2)C?+1) = 

hence the roots of the characteristic equation are 

s = -l 

s = 0±)V2 

and the transient response is 

c{t) = Aq~ 1 + Bsirv(\/2t + </>) 

From equation (5.37) it can be seen that when the proportional controller gain K\ is 
set to 0.25, the system will oscillate continuously at a frequency of y/l rad/s. 



(5.37) 
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5.2.2 Special cases of the Routh array 



Case 1: A zero in the first column 

If there is a zero in the first column, then further calculation cannot normally proceed 
since it will involve dividing by zero. The problem is solved by replacing the zero with 
a small number e which can be assumed to be either positive or negative. When the 
array is complete, the signs of the elements in the first column are evaluated by 
allowing e to approach zero. 



Example 5.3 

s 4 + 2s 3 + 2s 2 + 4s + 3 = 



3 

4 -6/e 

e 3 

2 4 

1 2 3 



(5.38) 



Irrespective of whether e is a small positive or negative number in array (5.38), there 
will be two sign changes in the first column. 

Case 2: All elements in a row are zero 

If all the elements of a particular row are zero, then they are replaced by the 
derivatives of an auxiliary polynomial, formed from the elements of the previous row. 



Example 5.4 



2/ + 6s 3 + 12s 2 + 8^+16 = 



16 






8/3 






6 


16 




8 


24 




2 


12 


16 


1 


6 


8 



(5.39) 



The elements of the s l row are zero in array (5.39). An auxiliary polynomial P(s) is 

therefore formed from the elements of the previous row (i 4 ). 

i.e. 

P(s) = 2/ + 12s 2 + 16 
dP(s) 



ds 



8s> + 24s 



(5.40) 



The coefficients of equation (5.40) become the elements of the s 3 row, allowing the 
array to be completed. 
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5.3 Root-locus analysis 
5.3.1 System poles and zeros 



The closed-loop transfer function for any feedback control system may be written in 
the factored form given in equation (5.41) 



(s) 



G(s) 



_ K C (S - Z c i)(s - Z c2 ) ...(■?- Zc„) 

1 + G(s)H(s) (s-p c i )(s - p c2 ) ...(s-p cn ) 



(5.41) 



where s = p c \, p C 2, . . . , p m are closed-loop poles, so called since their values make 
equation (5.41) infinite (Note that they are also the roots of the characteristic 
equation) and s = z c \, z c2 , . . . , z cn are closed-loop zeros, since their values make 
equation (5.41) zero. 

The position of the closed-loop poles in the s-plane determine the nature of the 
transient behaviour of the system as can be seen in Figure 5.5. Also, the open-loop 
transfer function may be expressed as 



G(s)H(s) 



K(s - zqi)(s - z 02 ) ...(s- z 0n ) 



(5.42) 



(S - poi)(s - p 02 ) ...(S- pon) 

where zoi, Z02, • • • , zo n are open-loop zeros and/>oi 5 7^02, • ■ ■ , Pon are open-loop poles. 




^L 





X I 






Fig. 5.5 Effect of closed-loop pole position in the s-plane on system transient response. 
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5.3.2 The root locus method 



This is a control system design technique developed by W.R. Evans (1948) that 
determines the roots of the characteristic equation (closed-loop poles) when the 
open-loop gain-constant K is increased from zero to infinity. 

The locus of the roots, or closed-loop poles are plotted in the s-plane. This is a 
complex plane, since s = a ± jo;. It is important to remember that the real part a is 
the index in the exponential term of the time response, and if positive will make the 
system unstable. Hence, any locus in the right-hand side of the plane represents an 
unstable system. The imaginary part cu is the frequency of transient oscillation. 

When a locus crosses the imaginary axis, a = 0. This is the condition of marginal 
stability, i.e. the control system is on the verge of instability, where transient oscilla- 
tions neither increase, nor decay, but remain at a constant value. 

The design method requires the closed-loop poles to be plotted in the s-plane as K 
is varied from zero to infinity, and then a value of /£ selected to provide the necessary 
transient response as required by the performance specification. The loci always 
commence at open-loop poles (denoted by x) and terminate at open-loop zeros 
(denoted by o) when they exist. 



Example 5.5 

Construct the root-locus diagram for the first-order control system shown in 

Figure 5.6. 



Solution 

Open-loop transfer function 



Open-loop poles 

Open-loop zeros: none 
Characteristic equation 

Substituting equation (5.3) gives 



G(s)H(s) 



s = 



K 
Ys 



1 + G(s)H(s) = 



Ts 
i.e. Ts + K = 



(5.43) 



(5.44) 



R(s) 



% 



<v - 


K 




C(s) 


y * 


Ts 













Fig. 5.6 First-order control system. 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC05.3D - 120 - [110-144/35] 9.8.2001 2:30PM 



1 20 Advanced Control Engineering 




\UJ 



Fig. 5.7 Root-locus diagram for a first-order system. 



Roots of characteristic equation 



K 






(5.45) 



When K is varied from zero to infinity the locus commences at the open-loop pole 
s = and terminates at minus infinity on the real axis as shown in Figure 5.7. 

From Figure 5.7 it can be seen that the system becomes more responsive as K is 
increased. In practice, there is an upper limit for K as signals and control elements 
saturate. 

Example 5.6 

Construct the root-locus diagram for the second-order control system shown in 

Figure 5.8. 

Open-loop transfer function 

G(s)H(s) = - - - (5.46) 



Open-loop poles 

Open-loop zeros: none 
Characteristic equation 



s(s + 4) 
j = 0,-4 

1 + G(s)H(s) = 



R(s) 



<v - 


K 




C(s) 


y " 


s(s + 4) 















Fig. 5.8 Second-order control system. 
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Table 5.1 Roots of second-order characteristic 
equation for different values of K 



K Characteristic equation 



Roots 



s 2 + 4s = 

4 s 2 + 4s + 4 = 

8 s 2 + 4s + 8 = 

16 s 2 +4s+16 = 



5 = 0,-4 
5= -2±j0 
s= -2±j2 
s=-2±j3.46 



Substituting equation (5.4) gives 



1 



a: 



o 



j(j + 4) 

i.e. s 2 + 4s + K = 



(5.47) 



Table 5.1 shows how equation (5.7) can be used to calculate the roots of the 
characteristic equation for different values of K. Figure 5.9 shows the corresponding 
root-locus diagram. 

In Figure 5.9, note that the loci commences at the open-loop poles (s = 0,-4) 
when K = 0. At K = 4 they branch into the complex space. This is called a break- 
away point and corresponds to critical damping. 



K=0 



/C=16 



K=8 



K=4 



K=0 



-1 



3 



-5 



-4 



-3 -2 



-1 



K=8 



^"{6 



-3 



Fig. 5.9 Root locus diagram for a second-order system. 
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5.3.3 General case for an underdamped second-order system 

For the generalized second-order transfer function given in equation (3.43), equating 
the denominator to zero gives the characteristic equation 



s 2 + 2(u; n s + uj\ = 
If ( < 1 in equation (5.48), then the roots of the characteristic equation are 

S\ 9 S 2 = -C^nij^nV 1 ~ C 

Hence a point P in the s-plane can be represented by Figure 5.10. 
From Figure 5.10, Radius 



OP 



y(-c^) 2 +(^^r^y 



Simplifying (5.50) gives 
Also from Figure 5.10 



OP 



COS/3 : 



-C^nl 



= C 



(5.48) 
(5.49) 

(5.50) 
(5.51) 

(5.52) 



Thus, as C is varied from zero to one, point P describes an arc of a circle of radius uj n , 
commencing on the imaginary axis ((3 = 90°) and finishing on the real axis (J3 = 0°). 

Limits for acceptable transient response in the s-plane 

If a system is 

(1) to be stable 

(2) to have acceptable transient response (£ > 0.5) 









\LO 


p 






^n V 1 -C 2 












■(\ 




-( 


U) n 




O (J 



Fig. 5.10 Roots of the characteristic equation for a second-order system shown in the s-plane. 
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Fig. 5.11 Region of acceptable transient response in the s-plane for ( > 0.5. 



then the closed-loop poles must lie in an area defined by 

/3 = ±cos _1 0.5 = ±60° 
This is illustrated in Figure 5.11. 



(5.53) 



5.3.4 Rules for root locus construction 



Angle and magnitude criteria 

The characteristic equation for a closed-loop system (5.24) may also be written as 



G(s)H(s) = -l 



(5.54) 



Since equation (5.54) is a vector quantity, it can be represented in terms of angle and 
magnitude as 



/G(s)H(s) = 180° 
\G(s)H(s)\ = 1 



(5.55) 
(5.56) 



The angle criterion 

Equation (5.55) may be interpreted as 'For a point s\ to lie on the locus, the sum of 
all angles for vectors between open-loop poles (positive angles) and zeros (negative 
angles) to point s\ must equal 180°.' 

In general, this statement can be expressed as 



E Pole Angles - E Zero Angles = 180° 



(5.57) 
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Fig. 5.12 Application of the angle criterion. 

Example 5.7 

Consider an open-loop transfer function 

G(s)H(s) = 



K(s + a) 
s(s + b)(s + c) 



Figure 5.12 shows vectors from open-loop poles and zeros to a trial point s\. From 
Figure 5.12 and equation (5.57), for s\ to lie on a locus, then 



(01 +02 + 3 ) -(00 =180° 



(5.58) 



The magnitude criterion 

If a point s\ lies on a locus, then the value of the open-loop gain constant K at that 
point may be evaluated by using the magnitude criterion. 
Equation (5.56) can be expressed as 



or 



i^i/i^)!!. 

|Jc wr 

\D(s) 



1 



K 



\N(s)\ 



Equation (5.60) may be written as 

_ Product of pole vector magnitudes 
Product of zero vector magnitudes 



(5.59) 



(5.60) 



(5.61) 
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Fig. 5.13 Application of the magnitude criterion. 



For Example 5.7, if s\ lies on a locus, then the pole and zero magnitudes are shown in 
Figure 5.13. From Figure 5.13 and equation (5.61), the value of the open-loop gain 
constant K at position s\ is 



K = 



(5.62) 



If there are no open-loop zeros in the transfer function, then the denominator of 
equation (5.62) is unity. 



5.3.5 Root locus construction rules 



1. Starting points (K = 0): The root loci start at the open-loop poles. 

2. Termination points (K = oo): The root loci terminate at the open-loop zeros when 
they exist, otherwise at infinity. 

3. Number of distinct root loci: This is equal to the order of the characteristic equation. 

4. Symmetry of root loci: The root loci are symmetrical about the real axis. 

5. Root locus asymptotes: For large values of k the root loci are asymptotic to 
straight lines, with angles given by 

n + 2k ) 



(n — m) 



where 

k = 0, l,...(n-m- 1) 

n = no. of finite open-loop poles 

m = no. of finite open-loop zeros 
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6. Asymptote intersection: The asymptotes intersect the real axis at a point given by 
E open-loop poles - E open-loop zeros 

a a = 7 \ 

(n — m) 

1 . Root locus locations on real axis: A point on the real axis is part of the loci if the sum 
of the number of open-loop poles and zeros to the right of the point concerned is odd. 

8. Breakaway points'. The points at which a locus breaks away from the real axis can 
be calculated using one of two methods: 



(a) Find the roots of the equation 

= 



~ds~ 



s=a h 



where K has been made the subject of the characteristic equation i.e. K = . . . 
(b) Solving the relationship 

n -i m -i 

V - = V - 

"Y(vb + \Pi\) V^ + k/l) 

where \pt\ and \z t \ are the absolute values of open-loop poles and zeros and 
Ob is the breakaway point. 

9. Imaginary axis crossover. The location on the imaginary axis of the loci (mar- 
ginal stability) can be calculated using either: 

(a) The Routh-Hurwitz stability criterion. 

(b) Replacing s by juj in the characteristic equation (since a = on the imagin- 
ary axis). 

10. Angles of departure and arrival. Computed using the angle criterion, by position- 
ing a trial point at a complex open-loop pole (departure) or zero (arrival). 

11. Determination of points on root loci: Exact points on root loci are found using the 
angle criterion. 

12. Determination of K on root loci: The value of K on root loci is found using the 
magnitude criterion. 

Example 5.8 (See also Appendix 1, examp58.m and examp58a.m) 
A control system has the following open-loop transfer function 

G(s)H(s) K 



s(s + 2)(s + 5) 

(a) Sketch the root locus diagram by obtaining asymptotes, breakaway point and 
imaginary axis crossover point. What is the value of K for marginal stability? 

(b) Locate a point on the locus that corresponds to a closed-loop damping ratio of 
0.5. What is the value of K for this condition? What are the roots of the 
characteristic equation (closed-loop poles) for this value of Kl 
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Solution 
Part (a) 

Open loop poles: s = 0, — 2, — 5 n = 3 

Open-loop zeros: none m = 

Asymptote angles (Rule 5) 

= (1 + 0)7T = 7T 

1 3-0 3 

/> (1+2)7T 



3-0 



60°, £ = (5.63) 

tt=180°, k=\ (5.64) 



(9 3 = (1 ^ 4)7F = y = 300 °(-60 o ), ^ = 2 > i- e - « - m - 1 (5.65) 



Asymptote intersection (Rule 6) 

{(0) + (-2) + (-5)}-0 



(5.66) 



3-0 
a a = -2.33 (5.67) 



Characteristic equation: From equation (5.24) 

' 4s + 2)Cs + 5) 



1+- — - = (5.68) 



or 

4s + 2)(.s + 5) + K = 
giving 

^+7^ + 10^ + ^ = (5.69) 

Breakaway points (Rule 8) 
Method (a): Re-arrange the characteristic equation (5.69) to make TTthe subject 



K = -s 3 - Is 2 - 10s (5.70) 



&K 



3s 2 - 14s- 10 = (5.71) 



d* 
Multiplying through by -1 

3^ + 14s +10 = (5.72) 

-14 + V14 2 - 120 

su s 2 = cr b = 

6 

a h = -3.79, -0.884 (5.73) 
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Method (b) 






11 1 

1 1 — 




cr b a b + 2 a b + 5 


Multiplying 


through by, 




(TbOb + 2)(a b + 5) 




(a b + 2)((7 b + 5) + a b (a b + 5) + cr b (a b + 2) 




<Tb + 7a b + 10 + o\ + 5a b + ag + 2a b = 




3al + 14a b + 10 = 




a b = -3.79, - 0.884 



(5.74) 



(5.75) 



(5.76) 

Note that equations (5.72) and (5.75) are identical, and therefore give the same roots. 
The first root, —3.79 lies at a point where there are an even number of open-loop poles to 
the right, and therefore is not valid. The second root, —0.884 has odd open-loop poles to 
the right, and is valid. In general, method (a) requires less computation than method (b). 

Imaginary axis crossover (Rule 9) 
Method (a) (Routh-Hurwitz) 



K 




(70- 


-K)\l 


7 


K 


1 


10 



From Routh's array, marginal stability occurs at K = 70. 

Method (b): Substitute s = jcu into characteristic equation. From characteristic 
equation (5.69) 



Equating imaginary parts gives 



(j^) 3 + 7(j^) 2 
< 3 - lu? - 



f 10(jcj) + ^ = 
I0juj + K = 



(5.77) 



-co 5 + IOuj = 

u? = 10 
uo = =L3.16rad/s 



Equating real parts gives 



-l00 2 + K : 

^K = loo 2 -- 



= 

70 



(5.78) 



(5.79) 



Note that method (b) provides both the crossover value (i.e. the frequency of 
oscillation at marginal stability) and the open-loop gain constant. 
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Fig. 5.14 Sketch of root-locus diagram for Example 5.8. 



-1 



The root locus diagram is shown in Figure 5.14. 
Part (b) From equation (5.52), line of constant damping ratio is 

(3 = cos^OO = cos- 1 ^) = 60° 



(5.80) 



This line is plotted on Figure 5.14 and trial points along it tested using the angle 
criterion, i.e. 



01 +6> 2 + 6> 3 = 180° 
Ats = -0.7+jl.25 
120 + 44+16 = 180° 



(5.81) 

(5.82) 



Hence point lies on the locus. 



Value of open-loop gain constant K: Applying the magnitude criterion to the above 
point 



K=\a\\b\\c\ 

= 1.4 x 1.8 x4.5 = 11.35 



(5.83) 
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x+ 5 



x+2 



\UJ 



-5 



-2 



Fig. 5.15 Determination of real closed-loop pole. 

Closed-loop poles (For K = 1 1.35): Since the closed-loop system is third-order, there 
are three closed-loop poles. Two of them are given in equation (5.81). The third lies 
on the real locus that extends from —5 to — oo. Its value is calculated using the 
magnitude criterion as shown in Figure 5.15. 
From Figure 5.15 



x(x + 2)(x + 5) = 11.35 



(5.84) 



Substituting x = 0.73 (i.e. s\ = —5.73) in equation (5.84) provides a solution. Hence 
the closed-loop poles for K = 11.35 are 



-5.73, -0.7zbjl.25 



(5.85) 



Example 5.9 (See also Appendix 1, examp59.m) 

The open-loop transfer function for a control system is 



G(s)H(s) 



K 



4? 2 +4s+ 13) 



Find the asymptotes and angles of departure and hence sketch the root locus 
diagram. Locate a point on the complex locus that corresponds to a damping ratio 
of 0.25 and hence find 

(a) the value of K at this point 

(b) the value of K for marginal stability 



Solution 
Open-loop poles: s 



0, 



-4±Vl6-52 



-2±j3 n = 3 



Open-loop zeros: None m = 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC05.3D - 131 - [110-144/35] 9.8.2001 2:30PM 



Classical design in the s-plane 131 

Asymptote angles (Rule 5) 

" (1+0)7r * 60°, k = (5.86) 



n 



3-0 3 

(1 + 2)7T 



3-0 



7r=180°, k=\ (5.87) 



CI + 4)^ 5tt 
^3= 3 _ =y=300°, k = 2, n-m-1 (5.88) 



Asymptote intersection (Rule 6) 

_{(0) + (-2+j3) + (-2-j3)}-0 



(5.89) 



3 

(7 a = -1.333 (5.90) 

Characteristic equation 

s 3 +4s 2 + 13^ + ^ = (5.91) 

Breakaway points'. None, due to complex open-loop poles. 

Imaginary axis crossover (Rule 9) 
Method (b) 

G^) 3 +4G^) 2 + 13jcj + i: = 
or 

-)u? - Au? + 13jcj + 7r = (5.92) 

Equating imaginary parts 

-cj 3 + 13cj = 

cj 2 = 13 
cj = ±3.6rad/s (5.93) 

Equating real parts 

-4uo 2 + A = 

A: = 52 (5.94) 

Angle of departure (Rule 10): If angle of departure is d , then from Figure 5.16 

#a + #b + #d = 180° 

e d = m-o a -o b 

d = 180 - 123 - 90 = -33° (5.95) 

Locate point that corresponds to £ = 0.25. From equation (5.52) 

(3 = cos -1 (0.25) = 75.5° (5.96) 
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Fig. 5.16 Root locus diagram for Example 5.9. 



-4 -3 

Real Axis 



-2 



-1 



Plot line of constant damping ratio on Figure 5.16 and test trial points along it using 
angle criterion. 
Ats = -0.8+J2.9 

104.5 + 79.5-4= 180° 



Hence point lies on locus. 
Applying magnitude criterion 



^ = 3.0x 6.0 x 1.25 = 22.5 



(5.97) 



5.4 Design in the s-plane 



The root locus method provides a very powerful tool for control system design. The 
objective is to shape the loci so that closed-loop poles can be placed in the s-plane at 
positions that produce a transient response that meets a given performance specifica- 
tion. It should be noted that a root locus diagram does not provide information 
relating to steady-state response, so that steady-state errors may go undetected, 
unless checked by other means, i.e. time response. 
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Table 5.2 Compensator characteristics 



Compensator Characteristics 

PD One additional zero 

PI One additional zero 

One additional pole at origin 
PID Two additional zeros 

One additional pole at origin 



5.4.1 Compensator design 



A compensator, or controller, placed in the forward path of a control system will 
modify the shape of the loci if it contains additional poles and zeros. Characteristics 
of conventional compensators are given in Table 5.2. 

In compensator design, hand calculation is cumbersome, and a suitable computer 
package, such as MATLAB is generally used. 

Case Study 

Example 5.10 (See also Appendix 1, examp510.m) 

A control system has the open-loop transfer function given in Example 5.8, i.e. 

G(s)H(s)= — 1 K=\ 

s(s + 2)0 + 5) 

A PD compensator of the form 

G(s) = K l (s^a) (5.98) 

is to be introduced in the forward path to achieve a performance specification 

Overshoot less than 5% 

Settling time (±2%) less than 2 seconds 

Determine the values of K\ and a to meet the specification. 

Original controller 

The original controller may be considered to be a proportional controller of gain T^and the 
root locus diagram is shown in Figure 5.14. The selected value of K = 11.35 is for a 
damping ratio of 0.5 which has an overshoot of 16.3% in the time domain and is not 
acceptable. With a damping ratio of 0.7 the overshoot is 4.6% which is within specification. 
This corresponds to a controller gain of 7.13. The resulting time response for the original 
system (K= 1 1.35) is shown in Figure 5.20 where the settling time can be seen to be 5.4 
seconds, which is outside of the specification. This also applies to the condition K= 7.13. 

PD compensator design 

With the PD compensator of the form given in equation (5.98), the control problem, 
with reference, to Figure 5.14, is where to place the zero a on the real axis. Potential 
locations include: 

(i) Between the poles s = 0, — 2, i.e. at s = — 1 

(ii) At s = —2 (pole/zero cancellation) 

(iii) Between the poles s = -2, -5, i.e at s = -3 
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Fig. 5.17 Root locus diagram for compensator /C-|(s+ 1). 

Option 1 (zero positioned at s = -1): The cascaded compensator and plant transfer 
function become 



GWO) 



j(j + 2)(j + 5) 



(5.99) 



The root locus diagram is shown in Figure 5.17. 

It can be seen in Figure 5.17 that the pole at the origin and the zero at s = — 1 
dominate the response. With the complex loci, ( = 0.1 gives K\ a value of 15. 
However, this value of K\ occurs at —0.74 on the dominant real locus. The time 
response shown in Figure 5.20 shows the dominant first-order response with the 
oscillatory second-order response superimposed. The settling time is 3.9 seconds, 
which is outside of the specification. 



Option 2: (zero positioned at s 
function is 



-2): The cascaded compensator and plant transfer 



G(s)H(s) = 



s(s + 2)(s + 5) 



(5.100) 



The root locus diagram is shown in Figure 5.18. The pole/zero cancellation may be 
considered as a locus that starts at s = — 2 and finishes at s = —2, i.e. a point on 
the diagram. The remaining loci breakaway at s = —2.49 and look similar to the 
second-order system shown in Figure 5.9. The compensator gain K\ that corresponds 
to C = 0.7 is 12.8. The resulting time response is shown in Figure 5.20 and has an 
overshoot of 4.1% and a settling time of 1.7 seconds, which is within specification. 
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Fig. 5.18 Root locus diagram for compensator /Ci(s + 2). 



Option 3: (zero positioned at s 
function is 



-3): The cascaded compensator and plant transfer 



G(s)H(s) = 



Ki(s + 3) 

s(s + 2)0 + 5) 



(5.101) 



The root locus diagram is shown in Figure 5.19. In this case the real locus occurs 
between s = — 5 and —3 and the complex dominant loci breakaway at a^ = —1.15. 
Since these loci are further to the right than the previous option, the transient 
response will be slower. The compensator gain that corresponds to ( = 0.7 is 
K\ = 5.3. The resulting time response is shown in Figure 5.20, where the overshoot 
is 5.3% and the settling time is 3.1 seconds. 

Summary. Of the three compensators considered, only option 2 met the performance 
specification. The recommended compensator is therefore 



G(s)= 12.80 + 2) 



(5.102) 



Case study 



Example 5.11 (See also Appendix 1, examp511.m) 

A ship roll stabilization system is shown in Figure 5.21. The system parameters are 

Fin time constant Tf = 1.0 seconds 
Ship roll natural frequency cu n = 1.414 rad/s 
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Fig. 5.19 Root locus diagram for compensator /Ci (s + 3). 
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Fig. 5.20 Time response for the three options considered. 
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Fig. 5.21 Ship roll stabilization system. 



Ship roll damping ratio ( = 0.248 
Ship steady-state gain K s = 0.5 

Performance specification 

Without stabilization, the step response of the roll dynamics produces a 45% over- 
shoot and a settling time of 10 seconds. The stabilization control system is required to 
provide a step response with an overshoot of less than 25%, a settling time of less 
than 2 seconds, and zero steady-state error. 

(a) Proportional control: With a proportional gain K\, the open-loop transfer 
function is 



Inserting values 



where 



G{s)H{s) = 
G(s)H(s) 



i a- n 

(\ + T f s)(s 2 + 2(10^ + 10^) 


(5.103) 


K 


(5.104) 


(s + l)(s 2 + 0.7s + 2) 


K = K x K,u? n 


(5.105) 



Open-loop poles: s = -1, -0.35 ± jl.37 n = 3 
Open-loop zeros: None m = 



Asymptote angles (Rule 5) 



1= (1±^ = 6O°, * = 

3-0 3 

#2=^^ = ^=180°, k=l 



3-0 

(1 + 4) 5tt 



300°, A: = 2 



3-0 3 
Asymptote intersection (Rule 6) 

{(-1) + (-0.35 + jl.37) + (-0.35 -jl.37)} - 

aa= 3^0 

a a = -0.57 



(5.106) 
(5.107) 
(5.108) 

(5.109) 
(5.110) 
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Characteristic equation 

giving 



' + (, + l )(/ + ».T, + 2) °° ,511l) 



s 3 + Us 2 + 2.1s + (2 + K) = (5.112) 

Breakaway points: None 

Imaginary axis crossover (Rule 9) 
From characteristic equation (5.112) 



(jc^) 3 + 1.7(j^) 2 + 2.7G") + (2 + tf) = 


= 


-jcj 3 - 1 .7cj 2 + 2.7ju; + (2 + K) = 


= 


Equating imaginary parts 




-u? + 2.7cj = 




cj 2 = 2.7 




cj = ±1.643 rad/s 




Equating real parts 




-1.7^ 2 + (2 + 7T) = 





(5.113) 



K= \.lu? -2 = 2.59 (5.114) 

The root locus diagram is shown in Figure 5.22. It can be seen that proportional 
control is not appropriate since as the controller gain K\ is increased the complex loci 
head towards the imaginary axis, making the response even more oscillatory than the 
open-loop response, until at K = 2.59 (K\ = 2.59) the system becomes unstable. 
Also, since no pure integrator is present in the control loop, there will be significant 
steady-state errors. 

(b) PID control. In order to achieve an acceptable response, the complex loci need 
to be attracted into the left-hand-side of the s-plane. This might be achieved by 
placing a pair of complex zeros to the left of the open-loop poles. In addition, a pure 
integrator needs to be introduced. This points to a PID controller of the form 

G{s) = K^ + bs + c) 

s 

putting b = 4 and c = 8 gives a pair of complex zeros 

s = -2±j2 
The open-loop transfer function now becomes 

G(S)H(S) = ^+1)^ + 0.7, + 2) (5 - 116) 

The root locus diagram is shown in Figure 5.23. The control strategy however, 
has not worked. The pure integrator and the open-loop pole s= — 1 produce a 
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Fig. 5.22 Proportional control, ship roll stabilization system. 
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Fig. 5.23 PID control, ship roll stabilization system. 
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4 




4 -3 

Real Axis 



Fig. 5.24 PIDD control, ship roll stabilization system. 



breakaway point at s = -0.6. This in turn creates a second pair of complex loci that 
terminate at the new open-loop zeros, leaving the original complex loci to crossover 
the imaginary axis as before. 

(c) PIDD control: If an additional open-loop zero is placed on the real axis, to the 
left of the open-loop pole s = — 1, a further breakaway point will occur to the left of 
the new zero. This should have the effect of bringing one pair of complex loci back to 
the real axis, whilst allowing the original complex loci to terminate at the complex 
open-loop zeros. If a new real zero is placed at s = — 2, the open-loop transfer 
function becomes 

K(s + 2)0 2 + 4s + 8) 



G(s)H(s) 



' s(s + 1)0 2 + 0.7s + 2) 



(5.117) 



The resulting root-locus diagram is shown in Figure 5.24. 

The control strategy for the root-locus diagram shown in Figure 5.24 is called 
PIDD, because of the additional open-loop zero. The system is unstable between 
K = 0.17 and K = 1.06, but exhibits good transient response at K = 10.2 on both 
complex loci. 

Figure 5.25 shows the step response for (a) the hull roll action without a stabilizer 
system, and (b) the hull roll action with a controller/compensator with a control law 



G(s) 



\0.2(s + 2)(s 2 +4s + 8) 



(5.118) 
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Fig. 5.25 Ship hull step response with and without stabilizers system. 



System performance 

(i) Without stabilizer system 

Rise time (95%) 1.3 seconds 

Percentage Overshoot 45% 
Settling time (±2%) 10.0 seconds 

(ii) With stabilizer system 

Rise time (95%) 0.14 seconds 

Percentage overshoot 22.8% 
Settling time (±2%) 1 .4 seconds 
With the stabilizer system, the step response meets the performance specification. 



5.5 Further problems 

Example 5.12 

Use the Routh-Hurwitz criterion to determine the number of roots with positive real 

parts in the following characteristic equations 

(a) s 4 + 3s 3 + 6s 2 + 2s + 5 = Ans: two 

(b) s 5 + 2s 4 + 3s 3 + As 1 + Is + 1 = Ans: none 
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Example 5.13 

Find the value of the open-loop gain constant K to make the control system, whose 

open-loop transfer function is given below, just unstable. 

G(s)H(s) = f Ans: 72 

s(s+ 1)0 + 8) 



Example 5.14 

A feedback control system has the following open-loop transfer function 

G(s)H(s) K 



s(s + 1)0 + 5) 

(a) Sketch the root locus by obtaining asymptotes, breakaway point and imaginary 
axis cross-over point. 

(b) A compensating element having a transfer function G(s) = + 2) is now 
included in the open-loop transfer function. If the breakaway point is -0.56, 
sketch the new root locus. Comment on stability of the system with, and without 
the compensator. 

(c) Demonstrate that for the compensated system the co-ordinates —2.375, 
— 1.8 ± j 4.0 lie on the curve. What is the value of K for these points? 

Solution 

(a) a a = -2, a b = -0.47, uj = ±j2.24rad/s 

(b) With compensator, system stable for all K 

(c) ^ = 23 

Example 5.15 

A feedback control system employing proportional control has the following open- 
loop transfer function 

G(s)H(s) K 



0+i)0 2 + *+i) 

(a) Using asymptotes, sketch the root locus diagram for the closed-loop system and 
find 

(i) the angles of departure from any complex open-loop poles, 
(ii) the frequency of transient oscillation at the onset of instability, 
(iii) the value of K to give the dominant closed-loop poles a damping ratio ( of 
0.3 

(b) To improve the steady-state performance the proportional controller is replaced 
by a proportional plus integral controller. The forward-path transfer function 
now becomes 



^0+i)0 2 + s+i) 
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Demonstrate that 
(i) the two breakaway points occur at 



a bl = -0.623 

ab 2 = -2.53 

(ii) the imaginary axis crossover occurs when K = 0.464 

Solution 

(a) (i) ±30°, (ii) 1.414 rad/s, (iii) K = 0.55 

Example 5.16 

(a) The laser guided missile shown in Figure 5.26(a) has a pitch moment of inertia of 
90kgm 2 . The control fins produce a moment about the pitch mass centre of 
360 Nm per radian of fin angle (3. The fin positional control system has unity gain 
and possesses a time constant of 0.2 seconds. If all other aerodynamic effects are 
ignored, find the transfer functions of the control fins and missile (in pole-zero 
format) in the block diagram given in Figure 5.26(b). 

(b) You are to conduct a feasibility study to evaluate various forms of control 
action. Initially proportional control is to be considered. Using asymptotes only, 
construct the root locus diagram and give reasons why it would be unsuitable. 






Controller 




Fin Dynamics 




Missile 
Dynamics 




Us) tf?\ . 


G,(s) 


U(s) 

^ 


G 2 (s) 


P(s) 


G 3 (s) 


Us) 


-A 


L 




► 























(b) 



Fig. 5.26 Laser guided missile. 
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(c) An open-loop zero is now introduced at s = —2. Again construct the root-locus 
diagram using asymptotes and comment on the suitability of the system. 

(d) Open-loop zeros at s = —2 and s = — 3 are now introduced. Demonstrate that at 
s = -2.45 the complex loci join the real axis prior to terminating at the open- 
loop zeros. Show also that a trial point on the locus exists when jo; = 1.45 and the 
damping ratio ( = 0.1. Sketch the root locus diagram and evaluate the controller 
gain that corresponds to £ = 0.7. 

Solution 

(a) G 2 (s) = 5/(.y + 5) G 3 (s) = 4/s 2 

(b) System unstable for all K 

(c) System stable for all K 

(d) Controller gain = 0.24 
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Classical design in the 
frequency domain 



6.1 Frequency domain analysis 

Control system design in the frequency domain can be undertaken using a purely 
theoretical approach, or alternatively, using measurements taken from the compon- 
ents in the control loop. The technique allows transfer functions of both the system 
elements and the complete system to be estimated, and a suitable controller/compen- 
sator to be designed. 

Frequency domain analysis is concerned with the calculation or measurement of 
the steady-state system output when responding to a constant amplitude, variable 
frequency sinusoidal input. Steady-state errors, in terms of amplitude and phase 
relate directly to the dynamic characteristics, i.e. the transfer function, of the system. 

Consider a harmonic input 

0i(O = A\ sincot (6.1) 

This can be expressed in complex exponential form 

6>i(0 = A^ (6.2) 

The steady-state response of a linear system will be 

#o (0 = A 2 sin(o;f - (/)) (6.3) 

or 

O (O = ^ 2 e jM_0) (6.4) 

where </> is the phase relationship between the input and output sinewaves as shown in 
Figure 6.1. The amplitude ratio A 2 \A\ is called the modulus and given the symbol \G\. 
Thus 

£=\G\ (6.5) 

or 

A 2 =A X \G\ (6.6) 
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(t) = A 2 s\n(ujt-(f)) 




-1.5-1 
Fig. 6.1 Steady-state input and output sinusoidal response. 
Im 




Fig. 6.2 Harmonic response diagram. 

Substituting equation (6.6) into (6.3) 

o (t) = A x \G\Q iiu;t -^ 
= A x \G\Q ]UJt Q- ](t) 



(6.7) 
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o (t) = (A^QG^) 

= ft(0|G|e- jV (6.8) 

Since \G\ and </> are functions of uj, then equation (6.8) may be written 

6 f(w) = \G(co)\e->^ (6.9) 

For a given value of cj, equation (6.9) represents a point in complex space P(uo). When 
uo is varied from zero to infinity, a locus will be generated in the complex space. This 
locus, shown in Figure 6.2, is in effect a polar plot, and is sometimes called a 
harmonic response diagram. An important feature of such a diagram is that its shape 
is uniquely related to the dynamic characteristics of the system. 

6.2 The complex frequency approach 

Relationship between s and juu. From equation (6.2) 

0i(f) = A x ^ 

dO 

- = MA l en=ju;6 i (t) 

Taking Laplace transforms 

s0 { (s) = }u0i(s) (6.10) 

or 

s=juu (6.11) 

Hence, for a sinusoidal input, the steady-state system response may be calculated by 
substituting s = juu into the transfer function and using the laws of complex algebra 
to calculate the modulus and phase angle. 

6.2.1 Frequency response characteristics of first-order systems 



From equation (3.23) 



hs) = G(s) = -?— (6.12) 

0[ 1 + Ts 



For a sinusoidal input, substitute equation (6.11) into (6.12). 

^(j W ) = G(j W ) = — ^- (6.13) 

Vi 1 +}uiT 

Rationalize, by multiplying numerator and denominator of equation (6.13) by the 
conjugate of (6.13), i.e. 



K(\ - \,.,T\ 

(6.14) 



(\+)loT){\-]uT) 

K(\ -\loT) 

\+u 2 T 2 
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Equation (6.14) is a complex quantity of the form a + ]b where 

Real part a = 

Imaginary part b 



\+uo 2 T 2 
-KujT 

~ 1+uj 2 T 2 



(6.15) 
(6.16) 



Hence equation (6.14) can be plotted in the complex space (Argand Diagram) to 
produce a harmonic response diagram as shown in Figure 6.3. 

In Figure 6.3 it is convenient to use polar co-ordinates, as they are the modulus and 
phase angle as depicted in Figure 6.2. From Figure 6.3, the polar co-ordinates are 



|G(jcj)| = Va 2 + b 2 



which simplifies to give 



\G(jco)\ 



K y / -KujT 

\+uj 2 T 2 ) + \\+co 2 T 2 

K 



V\+uj 2 T 2 



(6.17) 



(6.18) 



Comparing equations (6.14) and (6.18), providing there are no zeros in the transfer 
function, it is generally true to say 

\G(ju)\=—= = (6.19) 

A/Denominator of G{)uS) 




Fig. 6.3 A point in complex space for a first-order system. 
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(a) Polar Plot 




0.707K 



ZGQlu) 
(degrees) 



uj (rad/s) 



(b) Rectangular Plot (Frequency Response) 
Fig. 6.4 Graphical display of frequency domain data for a first-order system. 




uj (rad/s) 



Table 6.1 


Modulus and phase 


for a first-order system 


uj (rad/s) 


\GQuj)\ 




IG(juj) (degrees) 




i/r 

oo 


K 

K/V2 





-0 
-45 
-90 



The argument, or phase angle is 



IG(juj) = tan" 



= tan 



{ -KtvT 
\+u 2 T 2 
1+uj 2 T 2 



which gives 



ZG(jcj) = tan _1 (-cjr) 



(6.20) 



(6.21) 
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Using equations (6.18) and (6.21), values for the modulus and phase angle may be 
calculated as shown in Table 6.1. The results in Table 6.1 may be represented as a 
Polar Plot, Figure 6.4(a) or as a rectangular plot, Figures 6.4(b) and (c). Since the 
rectangular plots show the system response as a function of frequency, they are 
usually referred to as frequency response diagrams. 



6.2.2 Frequency response characteristics of second-order 
systems 

From equation (3.42) the standard form of transfer function for a second-order 
system is 

G(s) K 



Substituting s =]uo 



or 



GQco) 



G{JLO) = 



K 

(j w ) 2 + |(j w )+l 

K 



Rationalizing gives 



K 



GQlo) 



{'-fe) 2 }-^)} 



J -fe) 2 } + { 2C fe)} 2 



Using equations (6.17) and (6.19), the modulus is 
\G(}oj)\=- f = 



And from equation (6.20), the argument is 

ZG(jc) = tan- 1 W> 

< ~ V^J > 
Table 6.2 Modulus and phase for a second-order system 



cj (rad/s) 




\G()uj)\ 

K 

K/2( 




/G(jcj) (degrees) 

-0 

-90 

-180 



(6.22) 



(6.23) 



(6.24) 



(6.25) 



(6.26) 



(6.27) 
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Re 



Fig. 6.5 Polar plot of a second-order system. 

From equations (6.26) and (6.27) the modulus and phase may be calculated as shown 
in Table 6.2. The results in Table 6.2 are a function of ( and may be represented as a 
Polar Plot, Figure 6.5, or by the frequency response diagrams given in Figure 6.6. 



6.3 The Bode diagram 

The Bode diagram is a logarithmic version of the frequency response diagrams 
illustrated in Figures 6.4(b) and (c), and also Figure 6.6, and consists of 

(i) a log modus-log frequency plot 
(ii) a linear phase-log frequency plot. 

The technique uses asymptotes to quickly construct frequency response diagrams by 
hand. The construction of diagrams for high-order systems is achieved by simple 
graphical addition of the individual diagrams of the separate elements in the system. 
The modulus is plotted on a linear j-axis scale in deciBels, where 



|G(jw)|d5=201og 10 |G(jw)| 



(6.28) 



The frequency is plotted on a logarithmic x-axis scale. 
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Fig. 6.6 Frequency response diagrams for a second-order system. 

6.3.1 Summation of system elements on a Bode diagram 

Consider two elements in cascade as shown in Figure 6.7. 

GxQlj) = |Gi(jw)|eJ* 
G 2 Qlj) = |G 2 (jo;)|e^ 



(6.29) 
(6.30) 
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RQu)- 



GiG") 



G 2 (\u) 



■> CQu) 



Fig. 6.7 Summation of two elements in cascade. 



Hence 



C 

-(jw) = Gi(j(J)G 2 (ju)) 

= |Gi(jo;)||G2(ja;)|e- 



K01+02) 



§<*> 



= |Gi(jw)||G2(jw) 



(6.31) 



or 



and 



~R^ 



dB = 201og 10 |Gi(jo;)| + 201og 10 |G 2 (jo;) 



C 

1 r(^ = 01 + 02 = £Gi(]lJ) + ZG 2 (ju;) 



(6.32) 



(6.33) 



In general, the complete system frequency response is obtained by summation of the 
log modulus of the system elements, and also summation of the phase of the system 
elements. 



6.3.2 Asymptotic approximation on Bode diagrams 

(a) First-order lag systems 

These are conventional first-order systems where the phase of the output lags behind 
the phase of the input. 

(i) Log modulus plot: This consists of a low-frequency asymptote and a high- 
frequency asymptote, which are obtained from equation (6.18). 

Low frequency (LF) asymptote: When uj — > 0, |G(jo;)| — > K. Hence the LF 

asymptote is a horizontal line at T^dB. 

High frequency (HF) asymptote: When uj ^> l/T, equation (6.18) approximates 

to 



|G(jo;)| 



K 



(6.34) 



As can be seen from equation (6.34), each time the frequency doubles (an increase of 
one octave) the modulus halves, or falls by 6dB. Or alternatively, each time the 
frequency increases by a factor of 10 (decade), the modulus falls by 10, or 20 dB. 
Hence the HF asymptote for a first-order system has a slope which can be expressed 
as -6dB per octave, or -20 dB per decade. 
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From equation (6.34), when u = l/T, the HF asymptote has a value of K. Hence 
the asymptotes intersect at uj = 1/Trad/s. Also at this frequency, from equation 
(6.18) the exact modulus has a value 

Since 1/^/2 is —3 dB, the exact modulus passes 3 dB below the asymptote intersection 
at 1/Trad/s. The asymptotic construction of the log modulus Bode plot for a first- 
order system is shown in Figure 6.8. 



\Gi]u)\ 
dB 



LF Asymptote 














1 \ 

^ 1 


\ 


\ 


Ai 

3dB 


1 

1 
1 
1 
1 
1 
1 
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^U -6dB/octave 
N. (-20dB/decad 



T 



log uj 



Fig. 6.8 Bode modulus construction for a first-order system. 



ZG(jcj) 
(degrees) 



-45 



MF Asymptote 
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10- log lu 



Fig. 6.9 Bode phase construction for a first-order system. 
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(ii) Phase plot. This has three asymptotes 



• A LF horizontal asymptote at 0° 

• A HF horizontal asymptote at -90° 

• A Mid-Frequency (MF) asymptote that intersects the LF asymptote at 1/1 07 7 
and the HF asymptote at 10/T (i.e. a decade either side of 1/7"). 

The Bode phase plot for a first-order system is given in Figure 6.9. 

(b) First-order lead systems 

These are first-order systems where the phase of the output (in steady-state) leads the 
phase of the input. The transfer function of a first-order lead system is 

G(s) = K{\ + Ts) (6.35) 

and 



\G(]u)\ = KVl+uj 2 T 2 (6.36) 

lG(juj) = tcm- l (ujT) (6.37) 

The Bode diagram, given in Figure 6.10, is the mirror image, about the frequency 
axis, of the first-order lag system. Note that the transfer function given in equation 
(6.35) is also that of a PD controller. 

(c) Second-order systems 

(i) Log modulus plot 

LF asymptote: A horizontal line at KdB 

HF asymptote: When uj ^> uu n , equation (6.26) approximates to 

\G{]lo)\=-^ (6.38) 



(ft)' 



From equation (6.38), an octave increase in frequency will reduce the modulus by 
a quarter, or -12dB and a decade frequency increase will reduce the modulus 
by a factor of 100, or -40 dB. Hence the HF asymptote for a second-order system 
has a slope of -12dB/octave or -40 dB/decade. The LF and HF asymptotes inter- 
sect at uj = uj n . Also at uj n , the exact value of modulus from equation (6.26) is 

The value of the modulus relative to the LF asymptote is 

\G(jiu)\dB = 20 log 10 (^pj = 20 log 10 (£) (6.39) 
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\GQu)\ 
dB 




ZG(\lo) 
(degrees) 



Slope = +6 dB/octave 
(+20dB/decade) 



(a) Log modulus 



\ogcj 




logcj 



Fig. 6.10 Bode gain and phase for a first-order lead system. 



Hence 



C = 0.25, Relative modulus = +6dB 
C = 0.5, Relative modulus = OdB 
C = 1.0, Relative modulus = -6dB 

(ii) Phase plot: This has two asymptotes: 

• A LF horizontal asymptote at 0° 

• A HF horizontal asymptote at —180°. 

The phase curve passes through -90° at co = cu n . Its shape depends upon ( and is 
obtained from the standard curves given in Figure 6.11. 
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Fig. 6.1 1 Bode gain and phase for a second-order system. 
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(d) A pure integrator 

Consider a pure integrator of the form 



now 



G(s) 



Giju) 



Rationalizing 



From equation (6.17) 



GQco) 



K 

s 

K 

"0+jw 

K(0-yJ) 

LU 2 



\G(M 



K 2 oj 2 K 



UP Ul 



and from equation (6.20) 

lG(]ui) = tan" 



j / —Koj/oj 




(6.40) 



tan- 1 (-oo) = -90° 



(6.41) 



(6.42) 



(6.43) 



It can be seen from equation (6.42) that the modulus will halve in value each time the 
frequency is doubled, i.e. it has a slope of — 6dB/octave ( — 20dB/decade) over the 
complete frequency range. 
Note that 

\G(ju)\ =KdB whencj= 1 
\G(ju)\ = 1 = OdB when u = K 

The Bode diagram for a pure integrator is shown in Figure 6.12. 



\G{]d)\ 
dB 



■6 dB/octave 



20 dB/decade) 




ZG(\u;) 
(degrees) 



1.0 K logcc; 

Fig. 6.12 Bode diagram for a pure integrator. 



-90 



log uj 
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Example 6.1 (See also Appendix 1, examp61.m) 
Construct, using asymptotes, the Bode diagram for 

G(s) = TToJS (6 ' 44) 

Low Frequency asymptote is a horizontal line at KdB, 

i.e. +6dB 

Asymptote intersection (break frequency) occurs at l/T, i.e. 2rad/s. The Bode 
diagram is shown in Figure 6.13. 
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(b) Bode Phase 
Fig. 6.13 Bode diagram for G(s) = 2/1 + 0.5s. 
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Example 6.2 (See also Appendix 1, examp62.m) 
Draw the Bode diagram for 



G(s) = 



0.25s 2 + 0.2s + 1 



(6.45) 
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(b) Bode Phase 
Fig. 6.14 Bode diagram for a second-order system, K = 4, u n = 2, ( = 0.2. 
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Comparing equation (6.45) with the standard form given in (6.22) 

^r=0.25 

i.e. cj n = 2 rad/s 

^ = 0.2 

i.e. C = 0.2 
Low Frequency asymptote is a horizontal line at KdB 

i.e. 20 log 10 (4) = +12dB 
The log modulus relative to the LF asymptote at u = co n is given by equation (6.39) 

|G(j w )| Wii =201og 10 ^=8dB 

(Hence the absolute log modulus at u = u n is 20 dB). The Bode diagram is given by 
Figure 6.14. Note in Figure 6.14 that the phase curve was constructed by reading the 
phase from Figure 6.11(b), an octave either side of cj n . 

Example 6.3 

Construct, on log-linear graph paper, using asymptotes, and validate using 

MATLAB or a similar tool, the Bode diagrams for 

(a) G(s) = 

(b) G(s) = 

(c) G(s) = 

id)G(s)= s(0.25s2 + 0.ls+l) 

6.4 Stability in the frequency domain 
6.4.1 Conformal mapping and Cauchy's theorem 



4 


s(l + 2s) 
1 


(1 +0.5j)(1 +4s) 
10(1+5) 


(1 + 0.2s)(l + 5s) 
100 



In Chapter 5 the stability of linear control systems were considered in the s-plane. 
Using a process of conformal transformation or mapping, it is possible to map a 
contour from one complex plane to another. It is therefore possible to transfer 
stability information from the s-plane to another complex plane, the .F(s)-plane. 
The relationship between the contours in the two complex planes is given by 
Cauchy's theorem, which states: 'For a given contour in the s-plane that encircles 
P poles and Z zeros of the function F(s) in a clockwise direction, the resulting 
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(a) s-plane 
Fig. 6.15 Mapping of a contour from the s-plane to the F(s)-plane. 



(b) F(s)-plane 



contour in the F(V)-plane encircles the origin a total of N times in a clockwise 
direction'. 
Where 



N = Z-P 



Consider a function 



F(s) 



(s + Zj)(s + z 2 ) 
(s+pi)(s+p 2 ) 



(6.46) 



(6.47) 



where z\ and z 2 are zeros of F(s) and p\ and P2 are poles. Equation (6.47) can be 
written as 

F(s) = \F(s)\lF(s) 

The mapping of a contour from the s-plane to the F(V)-plane is shown in Figure 6.15. 
From Figure 6.15 

1*1161 



\F(s)\=- 



(6.48) 



and 



lf(s) = z i + </> z2 - <i> P \ - <t> P 2 (6.49) 

As s\ in Figure 6.15(a) is swept clockwise around the contour, it encircles two zeros 
and one pole. From Cauchy's theorem given in equation (6.46), the number of 
clockwise encirclements of the origin in Figure 6.15(b) is 

N = 2 - 1 = 1 (6.50) 

6.4.2 The Nyquist stability criterion 

A frequency domain stability criterion developed by Nyquist (1932) is based upon 
Cauchy's theorem. If the function F(s) is in fact the characteristic equation of a 
closed-loop control system, then 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC06.3D - 163 - [145-197/53] 9.8.2001 2:31PM 



Classical design in the frequency domain 1 63 



F(s) = 1 + G(s)H(s) 



(6.51) 



Note that the roots of the characteristic equation are the closed-loop poles, which are 
the zeros of F(s). 

In order to encircle any poles or zeros of F(s) that lie in the right-hand side of the 
s-plane, a Nyquist contour is constructed as shown in Figure 6.16. To avoid poles at 
the origin, a small semicircle of radius e, where e — > 0, is included. 

Figure 6.17(a) shows the 1 + G(s)H(s) plane when Z — P = 2, i.e. two clockwise 
encirclements. However, if the contour is plotted in G(s)H(s) plane as shown in 
Figure 6.17(b), then it moves one unit to the left, i.e. encircles the -1 point. 




Fig. 6.16 s-plane Nyquist contour. 
Im 





(a) -l+GisjHis) plane (b) G{s)H{s) plane 

Fig. 6.17 Contours in the 1 + G(s)H(s) and G(s)H(s) planes. 
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The Nyquist stability criterion can be stated as: 'A closed-loop control system is 
stable if, and only if, a contour in the G(s)H(s) plane describes a number of counter- 
clockwise encirclements of the (— 1, jO) point, the number of encirclements being 
equal to the number of poles of G(s)H(s) with positive real parts'. 

Hence, because there is a net clockwise encirclement of the (— 1, jO) point in Figure 
6.17(b) the system is unstable. If, however, there had been a net counter-clockwise 
encirclement, the system would have been stable, and the number of encirclements 
would have been equal to the number of poles of G(s)H(s) with positive real parts. 

For the condition P = 0, the Nyquist criterion is: 'A closed-loop control system is 
stable if, and only if, a contour in the G(s)H(s) plane does not encircle the (-1, jO) 
point when the number of poles of G(s)H(s) in the right-hand s-plane is zero'. 

In practice, only the frequencies uj = to +oo are of interest and since in the 
frequency domain s = jo;, a simplified Nyquist stability criterion, as shown in Figure 
6.18 is: 'A closed-loop system is stable if, and only if, the locus of the G{]uj)H(]uj) 
function does not enclose the (— l,j0) point as uj is varied from zero to infinity. 
Enclosing the (— 1, jO) point may be interpreted as passing to the left of the point'. 
The G(]uj)H()uj) locus is referred to as the Nyquist Diagram. 

An important difference between analysis of stability in the s-plane and stability in 
the frequency domain is that, in the former, system models in the form of transfer 
functions need to be known. In the latter, however, either models or a set of 
input-output measured open-loop frequency response data from an unknown system 
may be employed. 

Margins of stability 

The closer the open-loop frequency response locus G(]uj)H(]uj) is to the (— l,j0) 
point, the nearer the closed-loop system is to instability. In practice, all control 



G{](J)H(](J) plane 




Fig. 6.18 Nyquist diagram showing stable and unstable contours. 
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\ N Unit circle 

\ 
\ 




Fig. 6.19 Gain margin (GM) and phase margin (PM) on the Nyquist diagram. 



systems possess a Margin of Stability, generally referred to as gain and phase 
margins. These are shown in Figure 6.19. 

Gain Margin (GM): The gain margin is the increase in open-loop gain required 
when the open-loop phase is —180° to make the closed-loop system just unstable. 



Nyquist diagram 



Bode diagram 



GM 



1 



\G(ju)H(ju;)\ m 



GM = 20 log 



10 



1 



\G(]uj)H{]uj)\ 



(6.52) 



(6.53) 



180 > 



Phase Margin (PM) : The phase margin is the change in open-loop phase, required 
when the open-loop modulus is unity, (or dB on the Bode diagram) to make the 
closed-loop system just unstable. 

Phase Margin = 180 - IG( )uj)H(juj)(mod = 1) (6.54) 
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Fig. 6.20 Closed-loop control system. 

Example 6.4 (See also Appendix 1, examp64.m) 

Construct the Nyquist diagram for the control system shown in Figure 6.20 and find 

the controller gain K\ that 

(a) makes the system just unstable. (Confirm using the Routh stability criterion) 

(b) gives the system a gain margin of 2 (6 dB). What is now the phase margin? 



Solution 

Open-loop transfer function 



G(s)H(s) 



K 



s{s 2 + 2s + 4) 



where 



K = 4K } 



G(s)H(s) = 
G(ju;)H(jlu) = 



K 



s 3 + Is 2 + As 
K 



(]uoy + 2( jcoY + 4Jcj 
K 

-2(j 2 +j(4cj-cj 3 ) 



Rationalizing 



From equation (6.19) 



From equation (6.20) 



G(ju>)H(}u>) = 



K{-2u 2 -]^ 



■uj — a; 3 )} 



|G(j W )#(j W )| 



ZG(jw)tf<» = tan 



4w 4 + (4w - w 3 ) 2 



4w 4 + (4w - w 3 ) 2 



i / -(4a; -a; 3 ) 

-2o> 2 

4 - w 2 



tan 



2w 



(6.55) 
(6.56) 



(6.57) 



(6.58) 



(6.59) 
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Table 6.3 Data for Nyquist diagram for system in Figure 6.20 



uj (rad/s) 


0.5 


1.0 


1.5 


2.0 


2.5 


3.0 


4.0 


5.0 


\G(juj)H(juj)\(K = 1) 
LG(ju)H(ju) (deg) 


0.515 
-105 


0.278 
-124 


0.191 
-150 


0.125 
-180 


0.073 
-204 


0.043 
-220 


0.018 
-236 


0.0085 

-245 



The Nyquist diagram is constructed, for K = 1, at frequencies either side of the 180° 
point, which, from equation (6.59) can be seen to be co = 2 rad/s. Using equations 
(6.58) and (6.59), Table 6.3 may be evaluated. 

(a) From equation (6.52) 

GM = 1/0.125 = 8 

Value of K to make system just unstable 

^unstab = K • GM 



From equation (6.56) 



1x8 = 8 



K\ for instability = 2 



(b) For a GM of 2, the locus must pass through the (-0.5, jO) point in Figure 6.21. 
This can be done by multiplying all the modulus values in Table 6.3 by four and 
re-drawing Figure 6.21. Alternatively, the scales of Figure 6.21 can be multiplied 
by a factor of four (without re-drawing). Hence the unit circle is 0.25 x 4 and the 
PM can be seen to have a value of 50° when the GM is 2.0. 

Value of K to give a GM of 2 is the original K times 4, i.e. 1x4 = 4. From (6.56) 

K x = 1.0 

Hence, to give a GM of 2 and a PM of 50°, the controller gain must be set at 1 .0. If it 
is doubled, i.e. multiplied by the GM, then the system just becomes unstable. Check 
using the Routh stability criterion: 



Characteristic equation 



K 



Routh' s array 



1 s(s 2 + 2s + 4) " 


= 


+ 2s 2 + 4s + K = 


= 


K 




i(8 - K) 




2 K 




1 4 





(6.60) 
(6.61) 



Thus when K > 8 then the system is unstable. 
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Fig. 6.21 Nyquist diagram for system in Figure 6.20. 



System type classification 

Closed-loop control systems are classified according to the number of pure integra- 
tions in the open-loop transfer function. If 



G(s)H(s) 



, *nXi (*+'.-) 



(6.62) 



Then n in equation (6.62) is the 'type number' of the system and ]\ denotes the 
product of the factors. The system 'type' can be observed from the starting point 
(u — > 0) of the Nyquist diagram, and the system order from the finishing point 

(uo — > oo), see Figure 6.22. 

System 'type' and steady-state errors 

From the final value theorem given in equation (3.10) it is possible to define a set of 
steady-state error coefficients. 

1 . Position error coefficient 



K p = \im G(s) 



s^0 
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G(s)H(s) = 





(a) First-order type zero system 




(b) Second-order type one system 
Im 



(c) Third-order type two system 
Fig. 6.22 Relationship between system type classification and the Nyquist diagram. 
For a step input, 

2. Velocity error coefficient 



1 

1+^n 



(6.63) 



For a ramp input, 



3. Acceleration error coefficient 



For a parabolic input, 



K v =\im sG(s) 

j— ►() 



K v 



K A =1im s 2 G(s) 



(6.64) 



^ss — 



K a 



(6.65) 
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Table 6.4 Relationship between input function, system 
type and steady-state error 



Input function 




Steady-state error 






Type zero 


Type one 


Type two 


Step 

Ramp 

Parabolic 


constant 

increasing 

increasing 


zero 

constant 

increasing 


zero 
zero 
constant 



Table 6.4 shows the relationship between input function, system type and steady- 
state error. From Table 6.4 it might appear that it would be desirable to make most 
systems type two. It should be noted from Figure 6.22(c) that type two systems are 
unstable for all values of K, and will require some form of compensation (see 
Example 6.6). 

In general, type zero are unsatisfactory unless the open-loop gain K can be raised, 
without instability, to a sufficiently high value to make 1/(1 + K p ) acceptably small. 
Most control systems are type one, the integrator either occurring naturally, or 
deliberately included in the form of integral control action, i.e. PI or PID. 

Stability on the Bode diagram 

In general, it is more convenient to use the Bode diagram in control system design 
rather than the Nyquist diagram. This is because changes in open-loop gain do not 
affect the Bode phase diagram at all, and result in the Bode gain diagram retaining its 
shape, but just being shifted in the j-direction. 

With Example 6.4 (see also Appendix 1, examp64a.m and examp64b.m), when the 
controller gain set to K\ = 1.0, the open-loop transfer function is 

G( ^ ) = ^ + 4 2, + 4) (6 ' 66) 

Equation (6.66) represents a pure integrator and a second-order system of the form 

G(s)H(s) = - -——-L- (6.67) 

s(0.25s z + 0.5s + 1) 

As explained in Figure 6.12 the pure integrator asymptote will pass through OdB at 
l.Orad/s (for K = 1 in equation (6.67)) and the second-order element has an 
undamped natural frequency of 2.0rad/s and a damping ratio of 0.5. 

Figure 6.23(a), curve (i), shows the Bode gain diagram for the transfer function 
given in equation (6.66), which has a gain margin of 6 dB (the amount the open-loop 
gain has to be increased to make the system just unstable. Figure 6.23(a), curve (ii), 
shows the effect of increasing K by a factor of two (6 dB) to make the system just 
unstable. For curve (ii) the open-loop transfer function is 

s(s z + 2s + 4) 

Figure 6.23(b) shows the Bode phase diagram which is asymptotic to -90° at low 
frequencies and -270° at high frequencies, passing through -180° at 2rad/s. To 
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determine the phase margin, obtain the open-loop phase when the modulus is dB 
(on curve (i), Figure 6.23(a), this is approximately 1.1 rad/s), and subtract the phase 
from 180° to give a PM of 50° as shown. 
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Fig. 6.23 Stability on the Bode diagram. 
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6.5 Relationship between open-loop and closed-lo 
frequency response 

6.5.1 Closed-loop frequency response 

When designing a control system it is essential to 

(a) ensure that the system is stable for all operating regimes 

(b) ensure that the closed-loop performance meets the required specification. 

Time domain performance specifications are described in section 3.7 and Figure 3.21. 
Frequency domain performance specifications are given in terms of gain and phase 
margins to provide adequate stability together with information relating to the 
closed-loop frequency response. Figure 6.24 shows the closed-loop frequency 
response of a control system. The closed-loop modulus is usually defined as 



G") 



M 



(6.69) 



Bandwidth (c^b): This is the frequency at which the closed-loop modulus M has fallen 
by 3 dB below its zero frequency value. (This is not true for systems that do not 
operate down to dc levels.) 

Peak modulus (M p ): This is the maximum value that the closed-loop modulus M 
rises above its zero frequency value. 

Peak frequency (cj p ): This is the frequency that the peak modulus occurs. Note that 
6J p < cj b . 

Second-order system closed-loop frequency response 

Many closed-loop systems approximate to second-order systems. Equation (6.26) 
gives the general equation for modulus. If, when K is set to unity, this equation is 



I— (Ml a„ 



(M) 
(dB) -3 



Bandwidth 




^p ^b log u (rad/s) 



Fig. 6.24 Closed-loop frequency response. 
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squared, differentiated with respect to co 2 and equated to zero (to find a maximum), 
then 



1 



M v = n =, (6-70) 



^p=^ n Vl-2C 2 (6.71) 

If, as a rule-of-thumb, M v is limited to 3 dB (y/2), then from equations (6.70), (6.71) 
and Figure 6.11 

C = 0.38 

cj p = 0.84cj n (6.72) 

cj b = 1 .4cj n 

In general, for a unity feedback control system, the closed-loop frequency response is 
given by equation (6.73) 

C (\ \ G (^ ftLH'W 

R 1 + G(]u) 

Equation (6.73) can be expressed in rectangular co-ordinates as 

R^ = i + x(M + mM (6J4) 



Hence 



§<*"> 



x(M+mM\ (675) 

|l+Z(j W )+j7(j W )| ^^ 



Equation (6.75) can be expressed as an equation of a circle of the form 

M 2 \ 2 . _ 2 ( M x 2 



z(j " ) + m^t J+W - U^T» (6 - 76) 



i.e. 



centre Im^T'° 

radius ± 



(6.77) 



,M 2 -1 
Also, from equation (6.73) 

Ljfjoi) = 4*(j") + r(jw)) -1(1+ X(jto) + Y(JLo)) (6.78) 

let 

N = tan{ L-(ju)\ (6.79) 
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Equation (6.78) can also be expressed as an equation of a circle of the form 



*(j") 



Y(]uj) 



1 



1 fN 2 + 1 



(6.80) 



i.e. 



centre -1/2, 1/27V 

Vn 2 + i 



radius 



IN 



(6.81) 



The M and N circles can be superimposed on a Nyquist diagram (called a Hall chart) 
to directly obtain closed-loop frequency response information. 

Alternatively, the closed-loop frequency response can be obtained from a Nyquist 
diagram using the direct construction method shown in Figure 6.25. From equation 
(6.73) 



§<*"> 



MM 



IOBI 



|l+G(jw)| |AB| 



(6.82) 



Also from equation (6.73) 



z|(j W ) = ZG(jw)-Z(i + G(jw)) 
= ZCOB - ZOAB 



(6.83) 




Fig. 6.25 Closed-loop frequency response from Nyquist diagram using the direct construction method. 
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= -12 dB 



20 dB 



-40 dB 



-180 
Open-Loop Phase (deg) 



Fig. 6.26 The Nichols chart. 



Hence 



^(jo;) = -ZABO 



(6.84) 



The Nichols chart 

The Nichols chart shown in Figure 6.26 is a rectangular plot of open-loop phase on 
the x-axis against open-loop modulus (dB) on the j-axis. M and N contours are 
superimposed so that open-loop and closed-loop frequency response characteristics 
can be evaluated simultaneously. Like the Bode diagram, the effect of increasing the 
open-loop gain constant K is to move the open-loop frequency response locus in the 
j/-direction. The Nichols chart is one of the most useful tools in frequency domain 
analysis. 



Example 6.5 

For the control system given in Example 6.4, determine 

(a) The controller gain K\ to give the best flatband response. What is the bandwidth, 
gain margin and phase margin? 

(b) The controller gain K\ to give a peak modulus M p of 3 dB. What is the band- 
width, gain margin and phase margin? 
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(c) For the controller gain in (b), what, in the time domain, is the rise-time, settling 
time and percentage overshoot? 

Solution 



(a) The open-loop transfer function for Example 6.4 is given by equation (6.55) 

K 



G(s)H(s) 



s(s 2 + 2s + 4) 



(6.85) 



Figure 6.27 (see also Appendix 1, fig627.m) shows the Nichols chart for K = 4 
(controller gain K\ = 1). These are the settings shown in the Bode diagram in Figure 
6.23(a), curve (i), and (b), where 

Gain margin = 6 dB 
Phase margin = 50° 

From Figure 6.27 it can be seen that the peak modulus M v is 4dB, occurring at 
cj p = 1.63rad/s. The bandwidth cj b is 2.2rad/s. For the best flatband response, the 
open-loop frequency response locus should follow the dB M contour for as wide 



OdB 




-1 dB 



-3dB 



-6dB 



-12 dB 



-20 dB 



-200 -180 -160 -140 -120 -100 -80 -60 -40 -20 

Open-Loop Phase (deg) 

Fig. 6.27 Nichols chart for Example 6.5, K = 4. 
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-1 dB 



-3dB 



-6dB 



-12 dB 



-20 dB 



-200 -180 -160 -140 -120 -100 -80 
Open-Loop Phase (deg) 

Fig. 6.28 Nichols chart showing best f latband response (curve (a)) and response with A// p =3dB (curve (b)). 

a frequency range as possible. This is shown in Figure 6.28, curve (a). To obtain curve 
(a), the locus has been moved down by 2dB from that shown in Figure 6.27. This 
represents a gain reduction of 

gain reduction factor = alog( — 2/20) = 0.8 



Hence, for best flatband response 

1 = 4.0x0.8 = 3.2 
Controller gain K { = K/4 = 3.2/4 = 0.8 
From Nichols chart 

Gain margin = 8.15 dB 
Phase margin = 60° 

Bandwidth = 2.02 rad/s 



(6.86) 

(6.87) 
(6.88) 

(6.89) 



(b) To obtain curve (b), the locus has been moved down by 0.5 dB from that shown 
in Figure 6.27. This represents a gain reduction of 



gain reduction factor = alog( — 0.5/20) = 0.944 



(6.90) 
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Fig. 6.29 Closed-loop frequency response showing best flatband response (curve (b)) and response with 
A// p =3dB(curve(a)). 



Hence, for a peak modulus of M v = 3 dB, 

K = 4.0 x 0.944 = 3.8 
Controller gain K x = K/4 = 3.8/4 = 0.95 
From Nichols chart 

Gain margin = 6.36 dB 
Phase margin = 53° 
Bandwidth = 2.1 rad/s 



(6.91) 
(6.92) 



(6.93) 



Figure 6.29 (see also Appendix 1, fig629.m) shows the closed-loop modulus frequency 
response. Curve (a) is the best flatband response, curve (b) is the response with M p set 
to 3 dB. 



6.6 Compensator design in the frequency domain 

In section 4.5, controllers, particularly PID controllers for closed-loop systems were 
discussed. In Chapter 5 it was demonstrated how compensators could be designed 
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in the s-plane to improve system performance. In a similar manner, it is possible 
to design compensators (that are usually introduced in the forward path) using 
frequency domain techniques. 

The general approach is to re-shape the open-loop frequency response locus 
G(juj)H( ]uj) in such a manner that the closed-loop frequency response meets a given 
frequency domain specification in terms of bandwidth and peak modulus. 

PD cascade compensation: In Chapter 5, case-study Example 5.10, it was demon- 
strated how a cascaded PD compensator could improve both system performance 
and stability. However, in this chapter, Figure 6.10 gives the frequency response 
characteristics of a PD controller/compensator. The important thing to note about 
Figure 6.10 is that, in theory, above u=l/T, the log modulus increases at 
+6dB/octave for evermore. In practice this will not happen because eventually 
system elements will saturate. But what will happen, however, is that any high 
frequency noise in the system will be greatly amplified. It therefore becomes neces- 
sary, in a practical application, both with PD and PID controllers, to introduce, at 
some suitable high frequency, a low-pass filter. 

6.6.1 Phase lead compensation 

A phase lead compensator is different from the first- order lead system given in 
equation (6.35) and Figure 6.10 because it contains both numerator and denominator 
first-order transfer functions. 

(a) Passive lead compensation 

A passive lead network (using two resistors and one capacitor) has a transfer func- 
tion of the form 

a (1 + Ts) 
There are two disadvantages of passive lead compensation: 

(i) the time constants are linked 

(ii) the gain constant \/a is always less than unity (called insertion loss) and addi- 
tional amplification of value a is required to maintain the value of the open-loop 
gain K. 

(b) Active lead compensation 

An active lead compensation network is shown in Figure 6.30. For an inverting 
operational amplifier 

£(0~f (6.95, 

where Z x = input impedance and Zf = feedback impedance. 

Now 

1 = 1 | = l+*iCu 

Z\ R\ R\ 
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Fig. 6.30 Active lead compensation network. 
Hence 

Z; = 

and 

Z f = 



i?i 



1 + R x C x s 
Ri 



1 + R 2 C 2 s 
Inserting equations (6.96) and (6.97) into (6.95) 



Vi 



(s) 



-Ri 
R x 



\l+R 2 C 2 sj 



or, in general 



G(s) = K x 



\ + T x s 

\ + T 2 s 



(6.96) 



(6.97) 



(6.98) 



(6.99) 



Thus from equation (6.99) it can be seen that the system designer has complete 
flexibility since, K x , T\ and T 2 are not linked. For a lead network, T x must be greater 
than 772. The Bode diagram for an active lead network is shown in Figure 6.31. 
From equation (6.99) 



GiJfJ) 



«{ 



expanding 



giving 



<?0) 



G(jlo) 



(l+}coT 2 )) ' (l+u 2 T*) 

K x (i-iuT 2 +iuT x + T x T 2 u 2 ) 

(i+w 2 r|) 

K x {(l + T x T 2 u 2 )+ju(T x -T 2 )} 

(i+w 2 r 2 ) 



From equation (6.20) 



tan (A = 



<4T X - T 2 ) 

(\ + T x T 2 u 2 ) 



(6.100) 



(6.101) 



(6.102) 



(6.103) 
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Fig. 6.31 Frequency response characteristics of a lead compensator. 



To find u m , differentiate equation (6.103) with respect to lj, and equate to zero. This 
gives 
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(6.104) 
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(degrees; 




1.5 2 2.5 

(spacing (octaves) 

Fig. 6.32 Relationship between m and the spacing of 1 /7~i and 1 /T 2 in octaves. 



Substituting equation (6.104) into (6.103) to give 



tan 



[ pi-TV 

\2y/T\T 2j 



(6.105) 



The value of </> m depends upon the spacing of \\T\ and I/T2 on the logu; axis, see 
Figure 6.32. 

Design procedure for lead compensation 

1 . Set K to a suitable value so that any steady-state error criteria are met. 

2. Plot the open-loop frequency response and obtain the phase margin and the 
modulus crossover frequency, (i.e. the frequency at which the modulus passes 
through dB) 

3. Set cu m to the modulus crossover frequency and estimate the phase advance </> m 
required to provide a suitable phase margin. From equations (6.104) and (6.105), 
determine T\ and 7*2 . 

4. Plot the compensated system open-loop frequency response. Note that the 
modulus crossover frequency has now increased. Reduce the compensator gain 
K\ so that the modulus crossover frequency returns to its original value, and the 
desired phase margin is met. 

Case study 

Example 6.6 

The laser guided missile shown in Figure 5.26 has an open-loop transfer function 

(combining the fin dynamics and missile dynamics) of 



G(s)H(s) = 



20 



s 2 (s+5) 



(6.106) 
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Fig. 6.33 Nichols chart for uncompensated laser guided missile. 



Design a cascade lead compensator that will ensure stability and provide a phase 
margin of at least 30°, a bandwidth greater than 5rad/s and a peak closed-loop 
modulus M p of less than 6 dB. 

Solution 

The open-loop transfer function is third-order type 2, and is unstable for all values of 
open-loop gain K, as can be seen from the Nichols chart in Figure 6.33. From Figure 
6.33 it can be seen that the zero modulus crossover occurs at a frequency of 1.9 rad/s, 
with a phase margin of —21°. A lead compensator should therefore have its max- 
imum phase advance </> m at this frequency. However, inserting the lead compensator 
in the loop will change (increase) the modulus crossover frequency. 

Lead compensator design one 

Place cj m at the modulus crossover frequency of 2 rad/s and position the compen- 
sator corner frequencies an octave below, and an octave above this frequency. Set 
the compensator gain to unity. Hence 



co m = 2 rad/s l/T\ — 1 rad/s 1/72 = 4 rad/s 
^=1.0 ^ m = 36.9° 
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Fig. 6.34 Nichols chart for lead compensator, design one. 



The compensator is therefore 



G(s) = 



(1+J) 
(1 + 0.25s) 



(6.107) 



The Nichols chart for the uncompensated and compensated system (curve (a)) is shown 
in Figure 6.34 (see also Appendix l,fig634.m). From Figure 6.34, curve (a) 

Gain margin = 2 dB 
Phase margin = 4° 
Modulus crossover frequency = 3.0rad/s 

Figure 6.35 shows the Bode gain and phase for both compensated and uncompen- 
sated systems. From Figure 6.35, it can be seen that by reducing the open-loop gain 
by 5.4 dB, the original modulus crossover frequency, where the phase advance is 
a maximum, can be attained. 



Gain reduction = alog 



-5.4 
20 



0.537 



(6.108) 
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Hence the lead compensator transfer function is 

The open-loop frequency response contours for the compensator given in equation 
(6.109) are curves (b) in Figures 6.34 and 6.35 which produce 

Gain margin = 1 dB 
Phase margin =15° 
Modulus crossover frequency = 2 rad/s 
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Fig. 6.35 Bode gain and phase for lead compensator, design one. 
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Fig. 6.36 Closed-loop frequency response for lead compensator one. 

Figure 6.36 shows the closed-loop frequency response using lead compensator one 
and defined by equation (6.109) (modulus only). From Figure 6.36 

Peak modulus M p = 11.6dB 
Bandwidth = 3.4 rad/s 

This design does not meet the performance specification. 

Lead compensator design two 

From Figure 6.34 it can be seen that to achieve the desired phase margin of at least 
30° then the compensator must provide in the order of an additional 20° of phase 
advance, i.e. 57° in total, at the modulus crossover frequency. 

From Figure 6.32, this suggests four octaves between the corner frequencies. Let 
l/T\ remain at 1 rad/s and Position l/T 2 at 16 rad/s (4 octaves higher). This provides 

0m = 61.9° 

^m = 4 rad/s 
The design two compensator is therefore 



G(s) 



(1+0.0625^) 



(6.110) 



The open-loop Bode gain and phase with the lead compensator given in equation 
(6.1 10) inserted in the control loop is shown in Figure 6.37. From Figure 6.37 curve (i) 
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it can be seen that the modulus crossover frequency is 3.37rad/s, and the phase 
margin is (180 — 152.4), or 27.6°. This is close to, but does not quite achieve the 
specification. However, from Figure 6.37, the maximum phase advance of —145.3° 
occurs at 1.9 rad/s. At this frequency, the open-loop gain K is 6.8 dB. Therefore, if the 
open-loop gain is reduced by this amount as shown in Figure 6.37, curve (ii) then the 
modulus crossover frequency becomes 1.9 rad/s and the phase margin is (180 - 
145.3), or 34.7°, which is within specification. The compensator gain K\ therefore 
becomes 

K x =^\og{^\ =0.457 (6.111) 
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Fig. 6.37 Open-loop bode gain and phase for design two lead compensator. 
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Fig. 6.38 Nichols chart for lead compensator design two. 



Figure 6.38, curve (a) shows the Nichols chart for the value of K\ given in equation 
(6.111). It can be seen that M p = 5dB, but the bandwidth is 3.43rad/s, which is 
outside of specification. However, because of the shape of the locus, it is possible to 
reduce the gain margin (18.6 dB in curve (a)) which will increase the bandwidth, but 
not significantly change the peak modulus, or the phase margin. Figure 6.38, curve 
(b) shows the open-loop gain K increased by 4.85 dB. This now has a peak modulus 
of 5.5 dB, a phase margin of 30.6° and a bandwidth of 5.09rad/s, all of which are 
within specification. The new compensator gain K\ is therefore 



K x = 0.457 xalog^ 
= 0.457 x 1.748 = 0. 



(6.112) 



The final lead compensator is 



G(s) = 



0.8(1+5) 
(1+0.0625^) 



(6.113) 
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Fig. 6.39 Closed-loop frequency response for both lead compensator designs. 

System frequency domain performance 

Closed-loop peak M p = 5.5 dB 

Gain margin = 13.75 dB 
Bandwidth = 5.09 rad/s 
Phase margin = 30.6° 

Figure 6.39 shows, for both lead compensator designs, the closed-loop frequency 
response characteristics for the system. 



6.6.2 Phase lag compensation 



Using passive components, a phase lag compensator may be constructed, whose 
transfer function is of the form 

(1 + Ts) 



G{s) = 



(6.114) 



(1 + aTs) 

where a is a number greater than unity. Passive lag networks suffer the same 
disadvantages of passive lead networks as discussed earlier. 

The active network shown in Figure 6.30 has the transfer function given in 
equation (6.99) 

K x {\ + Tis) 



G(s) = 



(1 + T 2 s) 



(6.115) 
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Fig. 6.40 Frequency response characteristics of a lag compensator. 

When 7^2 is greater than T\ equation (6.115) is an active lag network, whose Bode 
diagram is shown in Figure 6.40. The relationships between T\, T 2 , cu m and </> m are as 
given in equations (6.104) and (6.105), except, in this case, </> m is negative. The same 
comment applies to Figure 6.32 which shows the relationship between the spacing of 
reciprocals of T 2 and T\ and <fi m . 

Design procedure for lag compensation 

1 . Set K to a suitable value so that any steady-state error criteria are met. 

2. Identify what modulus attenuation is required to provide an acceptable phase mar- 
gin and hence determine the spacing between \\T 2 and \\T\ (i.e. 6dB attenuation 
requires a one octave spacing, 12dB attenuation needs a two octave spacing, etc.). 

3. Position \\T\ one decade below the compensated modulus crossover frequency, 
and hence calculate cu m using equation (6.104). 

4. Adjust compensator gain K\ if necessary. 
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Case study 

Example 6. 7 

A process plant has an open-loop transfer function 

G( ^ ) = (i + o.5,) ( i TWT m (6 - 116) 

As it stands, when the loop is closed, the system is on the verge of instability, with a 
GM of 1 .4 dB, a PM of 4° and a modulus crossover frequency of 1 .4 rad/s. Reducing 
the open-loop gain K by 12 dB (i.e. K = 7.5) provides an acceptable GM of 13.5 dB, 
PM of 52° with a modulus crossover frequency of 0.6 rad/s. However, this gain 
setting produces an unacceptable step steady-state error of 12%. Design a lag 
compensator that maintains the open-loop gain K at 30, but provides gain and phase 
margins, similar to setting K at 7.5. What is now the steady-state step error? 

Solution 

Required modulus attenuation is 12 dB. This reduces the modulus crossover fre- 
quency from 1.4 to 0.6 rad/s. 

Position \jT\ one decade below 0.6 rad/s i.e. 0.06 rad/s. For a 12 dB attenuation, 
two octaves are required in the compensator, thus l/T 2 is positioned at 0.015 rad/s. 
From equation (6.104) co m is 0.03 rad/s, and from equation (6.105) (using a negative 
value), m = -36.9°. 

Hence the required lag compensator is 

*.(! + 16.67s) 
G(S)= (1+66.67.) (6 - U7) 

The compensated and uncompensated open-loop frequency response is shown in 
Figure 6.41. From this Figure the compensated gain margin is 12.5 dB, and the phase 
margin is 48°. In equation (6.1 17), K\ does not need to be adjusted, and can be set to 
unity. When responding to a step input, the steady-state error is now 4.6%. 



6.7 Relationship between frequency response and time 
response for closed-loop systems 



There are a few obvious relationships between the frequency response and time 
response of closed-loop systems: 

(i) As bandwidth increases, the time response will be more rapid, i.e. the settling 

time will decrease, 
(ii) The larger the closed-loop peak M p , the more oscillatory will be the time 

response. 
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Fig. 6.41 Lag compensated and uncompensated open-loop bode diagram for Example 6.7. 



Since many closed-loop systems approximate to second-order systems, a few inter- 
esting observations can be made. For the case when the frequency domain specifica- 
tion has limited the value of M p to 3 dB for a second-order system, then from 
equation (6.72) 



C = 0.38 
cj p = 0.84j n (frequency that M p occurs) 
cjb = 1.4o; n (bandwidth) 



(6.118) 
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Equation (3.73) gives the time for a second-order system to settle down to within a 
tolerance band of ±2% 



or 



3 912 
ts=~p^ (6.119) 



Inserting the values in equation (6.118) into equation (6.119) gives 

10.29 14.4 



U n UJ B 



(6.120) 



Thus the settling time is inversely proportional to the bandwidth. Comparing equa- 
tion (6.70) with equation (3.68) gives 

% overshoot = q~ 2 ^ m v x 100 (6.121) 

Hence a closed-loop system with an undamped natural frequency of l.Orad/s and a 
damping ratio of 0.38 has the following performance: 

• Frequency domain 

M p (equation (6.70)) = 1.422 = 3.06 dB 
ujb (equation (6.72)) = 1.4rad/s. 

• Time domain 

t s (equation (6.120)) = 10.29 seconds 
% overshoot (equation (6.121)) = 27.5% 



6.8 Further problems 



Example 6.8 

A spring-mass-damper system has a mass of 20 kg, a spring of stiffness 8000 N/m 
and a damper with a damping coefficient of 80 Ns/m. The system is excited by a 
constant amplitude harmonic forcing function of the form 

F(t)= 160 sine*;* 

(a) Determine the system transfer function relating F(t) and x(t) and calculate values 
for uo n and (. 

(b) What are the amplitudes of vibration when u has values of 1.0, 20 and 50rad/s. 

(c) Find the value of the damping coefficient to give critical damping and hence, with 
this value, determine again the amplitudes of vibration for the angular frequen- 
cies specified in (b). 

Solution 

(a) cj n = 20rad/s, £ = 0.1 

(b) 0.02 m, 0.1m and 0.0038 m 

(c) C = 800 Ns/m 0.02 m, 0.01m and 0.0028 m 
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Example 6.9 

Construct, using asymptotes and standard second-order phase diagrams, the Bode 

diagrams for 

(i) G(s) U 



(1 + 2s) 
(ii) G(s) 2 



(0.0025s 2 + 0.01s +1) 

l+2s 



1 + 0.5sj 
0.5 



(iii) G(s) = 4 

(iv) G(W )-^ 2+055+1) 

When the loop is closed, will the system in (iv) be stable or unstable? 

Solution 

The system will have marginal stability. 

Example 6.10 

A control system has an open-loop transfer function 

G(s)H(s) K 



s(0.25s 2 + 0.25s+l) 

Set K = 1 and plot the Nyquist diagram by calculating values of open-loop modulus 
and phase for angular frequency values from 0.8 to 3.0rad/s in increments of 
0.2rad/s. Hence find the value of K to give a gain margin of 2 (6dB). What is the 
phase margin at this value of KP. 

Solution 

K = 0.5, Phase margin = 82° 

Example 6.11 

An open-loop frequency response test on an unknown system produced the following 

results: 

cj(rad/s) 0.2 0.4 0.8 1.6 3.0 4.0 4.6 5 6 8 10 20 40 

\G{)uj)H{)uj)\ (dB) 28 22 16 10.7 7.5 7.3 7.0 6.0 0.9 -9.3 -28 -36 -54 
LG()u)H(]uj) (deg)-91 -92 -95 -100 -115 -138 -162 -180 -217 -244 -259-262-266 



Plot the Bode diagram on log-linear paper and determine 

(a) The open-loop transfer function. 

(b) The open-loop gain constant K to give a gain margin of 4.4 dB. What is the phase 
margin for this value of KP. 

(c) The closed-loop transfer function (unity feedback) for the value of K found in (b). 

(d) The closed-loop peak modulus M v and bandwidth. 
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Table 6.5 Open-loop frequency response data 



cj (rad/s) 0.1 0.3 0.7 1.0 1.5 2.0 3.0 5.0 10.0 

\GQuj)HQu;)\ (dB) 17 7 0.5 -2 -5 -9 -18.5 -33 -51 

IGQuj)H(juj) (deg) -92 -98 -112 -123 -150 -180 -220 -224 -258 



Solution 

(a)G ^ ) = <0.04/Al, + l) 

(b) K=l.5, Phase margin = 79° 

(c) -77 0) 



7T ' s 3 + 2.5s 2 + 25^ + 37.5 
(d) M p = 4.6 dB, uj b = 5.6rad/s. 

Example 6.12 

(a) An open-loop frequency response test on a unity feedback control system pro- 
duced the data given in Table 6.5. Plot the Bode Diagram and determine the 
system open-loop and closed-loop transfer functions. What are the phase and 
gain margins? 

(b) A phase lead compensation network of the form 

1 (1 + aTs) 
a (1 + Ts) 

is to be introduced in the forward path. The maximum phase advance (j) m is to be 
37° and is to occur at co m = 2 rad/s. Determine the expression for the phase angle 
(j) and hence prove that </> m and co m are as given below. Find from these expres- 
sions the values of a and T and calculate values for (j) when u: = 1, 1.5, 2, 3 and 
5 rad/s. Plot the compensator frequency response characteristics. 



= tan -1 



_2y / a_ 



UJ n 



T^l 



(c) Produce a table using the frequencies specified in part (a) for the compete open- 
loop frequency response including the compensation network and an amplifier to 
make up the insertion loss of I /a. 

Plot these results on a Nichols chart and determine 

(i) Maximum closed-loop peak modulus, M p 
(ii) Bandwidth (to -3dB point) 
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SolutiOn r. rj 

(a) G(s)H(s) 



s(0.25s 2 + 0.5s+\) 



% 



R y/ 0.356.s 3 + 0.714s 2 + 1.429s +1 
Phase margin = 66° and Gain margin = 9 dB 
1 f (l+«) 



ib)G(s) 4 l( l+0.25.)j 

(c) M v = 1 dB and Bandwidth = 2.7rad/s 

Example 6.13 

(a) A unity feedback control system has an open-loop transfer function 

G(s)H(s) l 



s(l+s)(l+0.5s) 



Construct, using asymptotes, the Bode diagram and read off values of open-loop 
modulus and phase for the following frequencies 

u (rad/s) = 0.1, 0.5, 1.0, 1.4, 2.0, 4.0, 6.0 and 10.0 

You may assume that at frequencies of 1.0 and 2.0 rad/s the open-loop phase angles 
are —162° and —198° respectively. 

Plot the results between 0.1 and 2.0 rad/s on a Nichols Chart and determine 

(i) the phase and gain margins 
(ii) the maximum closed-loop modulus M p 
(iii) the bandwidth to the — 3 dB point 

(b) The performance specification calls for a maximum closed-loop modulus of 
+ 1 dB and a bandwidth of at least 1.8 rad/s. In order to achieve this, the follow- 
ing active lead compensation element is placed in the forward path 

K X {\ + T x s) 
(1 + T 2 s) 

Show that the phase advance </> is given by 

\i4Tx - Ti) 



tan -1 



1 + T x T 2 co 2 



The frequency of maximum phase advance is to occur at the frequency that corre- 
sponds to -180° on the Bode diagram constructed in section (a). The lower break 
frequency l/T\ is to be half this value and the upper break frequency l/T 2 is to be 
twice this value. Evaluate T\ and T 2 and calculate values of <j) for the frequencies 
specified in section (a). Construct the Bode diagram for the compensation element 
for the condition K\ = 1 , and read off values of modulus at the same frequencies as 
the calculated phase values. 
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(c) Using the tables of modulus and phase for the plant and compensator found in 
sections (a) and (b), determine values for the new overall open-loop modulus and 
phase when the compensator is inserted in the forward path. 

Plot these results on a Nichols Chart and adjust the compensator gain ^so that the 
system achieves the required performance specification. 
What are now the values of 

(i) the phase and gain margins 
(ii) the maximum closed-loop modulus, M v 
(iii) the bandwidth 
(iv) the compensator gain constant K\ 

Solution 

(a) (i) Phase margin = 32° and Gain margin = 9.6 dB 
(ii) M p = 5 dB 
(iii) Bandwidth = 1.3rad/s 

K } K) (1+ 0.357s) 

(c) (i) Phase margin = 47° and Gain margin = 13.5 dB 
(ii) M p = 1 dB 
(iii) Bandwidth = 1.85rad/s 
(iv) K x = 0.861 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC07.3D - 198 - [198-231/34] 9.8.2001 2:33PM 



7 



Digital control system 
design 



7.1 Microprocessor control 

As a result of developments in microprocessor technology, the implementation of 
control algorithms is now invariably through the use of embedded microcontrollers 
rather than employing analogue devices. A typical system using microprocessor 
control is shown in Figure 7.1. 
In Figure 7.1 

• RAM is Random Access Memory and is used for general purpose working space 
during computation and data transfer. 

• ROM, PROM, EPROM is Read Only Memory, Programmable Read Only Mem- 
ory and Erasable Programmable Read Only Memory and are used for rapid 
sources of information that seldom, or never need to be modified. 

• A/D Converter converts analogue signals from sensors into digital form at a 
given sampling period T seconds and given resolution (8 bits, 16 bits, 24 bits, 
etc.) 

• D/A Converter converts digital signals into analogue signals suitable for driving 
actuators and other devices. 

The elements of a microprocessor controller (microcontroller) are shown in Figure 
7.2. Figure 7.2 shows a Central Processing Unit (CPU) which consists of 

• the Arithmetic Logic Unit (ALU) which performs arithmetic and logical oper- 
ations on the data 

and a number of registers, typically 

• Program Counter - incremented each time an instruction is executed 

• Accumulator(s) - can undertake arithmetic operations 

• Instruction register - holds current instruction 

• Data address register - holds memory address of data 

Control algorithms are implemented in either high level or low level language. The 
lowest level of code is executable machine code, which is a sequence of binary 
words that is understood by the CPU. A higher level of language is an assembler, 
which employs meaningful mnemonics and names for data addresses. Programs 
written in assembler are rapid in execution. At a higher level still are languages 
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Fig. 7.1 Microprocessor control of a plant. 
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Fig. 7.2 Elements of a microprocessor controller. 



such as C and C++, which are rapidly becoming industry standard for control 

software. 

The advantages of microprocessor control are 

• Versatility - programs may easily be changed 

• Sophistication - advanced control laws can be implemented. 
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The disadvantages of microprocessor control are 

• Works in discrete time - only snap-shots of the system output through the A/D 
converter are available. Hence, to ensure that all relevant data is available, the 
frequency of sampling is very important. 



7.2 Shannon's sampling theorem 

Shannon's sampling theorem states that 'A function f(t) that has a bandwidth co b is 
uniquely determined by a discrete set of sample values provided that the sampling 
frequency is greater than 2oV- The sampling frequency 2c^b is called the Nyquist 
frequency. 

It is rare in practise to work near to the limit given by Shannon's theorem. A useful 
rule of thumb is to sample the signal at about ten times higher than the highest 
frequency thought to be present. 

If a signal is sampled below Shannon's limit, then a lower frequency signal, called 
an alias may be constructed as shown in Figure 7.3. 

To ensure that aliasing does not take place, it is common practice to place an anti- 
aliasing filter before the A/D converter. This is an analogue low-pass filter with a 
break-frequency of 0.5cc; s where cu s is the sampling frequency (co s > lOc^b). The higher 
u s is in comparison to c^b, the more closely the digital system resembles an analogue 
one and as a result, the more applicable are the design methods described in Chapters 
5 and 6. 




-1.5 



Fig. 7.3 Construction of an alias due to undersampling. 
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7.3 Ideal sampling 



An ideal sample f*(i) of a continuous signal f(t) is a series of zero width impulses 
spaced at sampling time T seconds apart as shown in Figure 7.4. 
The sampled signal is represented by equation (7.1). 



f*(t) = ]T f(kT)8(t - kT) 



(7.1) 



where 8{t — kT) is the unit impulse function occurring at t = kT. 

A sampler (i.e. an A/D converter) is represented by a switch symbol as shown in 
Figure 7.5. It is possible to reconstruct f{t) approximately from/"*(f) by the use of a 
hold device, the most common of which is the zero-order hold (D/A converter) as 
shown in Figure 7.6. From Figure 7.6 it can be seen that a zero-order hold converts a 
series of impulses into a series of pulses of width T. Hence a unit impulse at time t is 
converted into a pulse of width T, which may be created by a positive unit step at 
time t, followed by a negative unit step at time (t — T), i.e. delayed by T. 

The transfer function for a zero-order hold is 



G h (s) 



1 1 

— — — i 

s s 

1 



Ts 



Ts 



(7.2) 



At) 



m 





f(6T) 



f(kT) 



(a) Continuous Signal 



tO T 27 37 47 57 67 k7 t 

(b) Sampled Signal 



Fig. 7.4 The sampling process. 



At) 




no 



Fig. 7.5 A sampler. 
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f*{t) 



f(t) 



.-• 4 ^ ^ 1 

* 

Irr 1 

*-— O 

T 



t 
(a) Discrete Time Signal (b) Continous Time Signal 

Fig. 7.6 Construction of a continuous signal using a zero-order hold. 



7.4 The z-transform 

The z-transform is the principal analytical tool for single-input-single- output dis- 
crete-time systems, and is analogous to the Laplace transform for continuous systems. 

Conceptually, the symbol z can be associated with discrete time shifting in a 
difference equation in the same way that s can be associated with differentiation in 
a differential equation. 

Taking Laplace transforms of equation (7.1), which is the ideal sampled signal, 
gives 



f*(s) = &[f*(t)] = ^TAkry 



kTs 



k=0 



or 



F\s) = Y,f(kT)(e sT ) 



k=0 



Define z as 



then 



z = e' 



sT 



F( Z ) = J2f( kT >~ k = z t/«] 



£=0 



In 'long-hand' form equation (7.6) is written as 

F(z) =/(0) +/(7>-' +/(27>" 2 + • • • +RkT)z- 



(7.3) 



(7.4) 



(7.5) 



(7.6) 



(7.7) 



Example 7.1 

Find the z-transform of the unit step function f(t) = 1. 
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Fig. 7.7 z-Transform of a sampled unit step function. 
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47 



Solution 

From equations (7.6) and (7.7) 



Z[l(t)] = J2HkT)z- 



or 



F(z) = 1 



£=0 



z-'+z" 2 



Figure 7.7 shows a graphical representation of equation (7.9). 
Equation (7.9) can be written in 'closed form' as 



Z[1(0] 



1 



(7.8) 



(7.9) 



z-1 1-z- 1 
Equations (7.9) and (7.10) can be shown to be the same by long division 



(7.10) 





1+z- 1 


+ z" 


2 + ... 


z - 


- \\z 

z- 1 

0+1 









1- 


-z- 1 






04 


■z" 1 








z" 1 - 


-z- 2 



(7.11) 



Table 7.1 gives Laplace and z- transforms of common functions, 
z-transform Theorems: 

(a) Linearity 



Z[f l (t)±f 2 (t)] = F 1 (z)±F 2 (z) 



(7.12) 
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Table 7.1 Common Laplace and z-transforms 



fit) ovfikT) F(s) F(z) 



1 


8(t) 


1 


2 


8{t - kT) 


Q -kTs 


3 


1(0 


1 
S 


4 


t 


1 

? 

1 



1 

z~* 
z 
z-\ 

Tz 



(s + a) 



1 -e" 



a z{\ - q-° t ) 

s(s + a) (z - l)(z - e-° r ) 



10 



1 *_ z { (.r-l + e^)z + (l-e^-.re^)} 

fl 5 2 (5 + «) fl ( z - l) 2 ( z - e-« r ) 

uj zsinc^r 

sin ujt -z ~ -^ — — — - 

s 1 +uj 1 z l — 2z cos ujT + 1 

s z(z — cos ujT) 

COS UJt -z =■ -= — 

5 2 +cj 2 z 2 - 2zcoscjr+ 1 

_„, . uj zc aT sin ujT 



(s + <x) 2 + uj 2 z 2 - 2ze~ aT cos ujT + e~ 2flr 

(5 + a) z 2 — zzT aT cos cjJ 

~[ s + ^) 2 + ^2 z 2_2 ze -^coscjr + e- 2flr 



(b) Initial Value Theorem 

(c) Final Value Theorem 



/(0) = lim F(z) (7.13) 



f (00) = lim 

z-1 



7.4.1 Inverse transformation 



-^'■^) 



(7.14) 



The discrete time response can be found using a number of methods. 

(aj Infinite power series method 

Example 7.2 

A sampled-data system has a transfer function 

G(s) ] 



J+l 
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If the sampling time is one second and the system is subject to a unit step input 
function, determine the discrete time response. (N.B. normally, a zero-order hold 
would be included, but, in the interest of simplicity, has been omitted.) Now 



from Table 7.1 



for T = 1 second 



X (z) = G(z)X l (z) (7.15) 

^)=(^)(^l) (7.16) 

^Mz^Xz^l) 



-.2 



By long division 



z 2 - 1.368z + 0.368 



l + 1.368z- 1 + 1.503z- 2 



z 2 - 1.368z + 0.368p 0~ 

z 2 - 1.368z + 0.368 



(7.17) 



0+1.368z -0.368 

1.368z- 1.871 +0.503Z" 1 

+ 1.503 -0.503Z- 1 

1.503 - 2.056Z" 1 + 0.553z~ 2 (7.18) 

Thus 

X (P) = 1 

x (l) = 1.368 
x (2) = 1.503 

(b) Difference equation method 

Consider a system of the form 

AT (z) -l+ fll z-i+ fl2 z-2 + ... (7 - 19) 

Thus 

(1 + a x z~ x + a 2 z- 2 + • • • )X (z) = (b + b x z~ x + b 2 z~ 2 + • • • )X l (z) (7.20) 

or 

X (z) = {-a x z~ x - a 2 z- 2 )X (z) + (b + b x z~ x + b 2 z~ 2 + • • • )X l (z) (7.21) 

Equation (7.21) can be expressed as a difference equation of the form 
x (kT) = —a x x (k — 1)7" — a 2 x (k — T)T — • • • 

+ b x { (kT) + bixi(k - \)T + b 2 x { (k - 2)T + • • • (7.22) 
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In Example 7.2 






is) 



1 



1 + J 

z 



0.368 



Equation (7.23) can be written as 

X 



00 



1 



(7.23) 



(7.24) 



(7.25) 
(7.26) 



X { v " 7 1 - 0.368Z- 1 
Equation (7.24) is in the same form as equation (7.19). Hence 

(1 - 0.368z- 1 )X o (z) = X { (z) 
or 

X (z) = 0.368z _1 X o (z) + X { (z) 

Equation (7.25) can be expressed as a difference equation 

x (kT) = 0.368x o (£ - \)T + Xi (kT) 

Assume that x (— 1) = and X[(kT) = 1, then from equation (7.26) 

x o (0) = 0+l = l, ^ = 

x (l) = (0.368 x 1) + 1 = 1.368, k = 1 

x (2) = (0.368 x 1.368) + 1 = 1.503, k = 2 etc. 

These results are the same as with the power series method, but difference equations 
are more suited to digital computation. 

7.4.2 The pulse transfer function 

Consider the block diagrams shown in Figure 7.8. In Figure 7.8(a) U*(s) is a sampled 
input to G(s) which gives a continuous output X (s), which when sampled by a 



X*(s) 




(a) 



U(z) 




Xo(z) 



(b) 



Fig. 7.8 Relationship between G(s) and G(z). 
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U(s) ^ 

T 



U*(s) 

► 



G,(s) 



X(s) 



>c 



X*(s) 



G 2 (s) 



X (s) 



^ 



X'o(s) 



(a) 



U(s) ^ U*(s) ^ 



GAs) 



X(s) 



G 2 (s) 



X (s) 



>\ 



X* (s) 



(b) 



Fig. 7.9 Blocks in cascade. 



synchronized sampler becomes X*(s). Figure 7.8(b) shows the pulse transfer function 
where U(z) is equivalent to U*(s) and X (z) is equivalent to X*(s). 
From Figure 7.8(b) the pulse transfer function is 



Xo_ 

u 



(z) = G(z) 



(7.27) 



Blocks in Cascade: In Figure 7.9(a) there are synchronized samplers either side of 
blocks G\(s) and G^C?). The pulse transfer function is therefore 



U 



(z) = G x {z)G 2 (z) 



(7.28) 



In Figure 7.9(b) there is no sampler between G\(s) and G^C?) so they can be combined 
to give G\(s)G2(s), or G\G2(s). Hence the output X (z) is given by 



X (z) = Z{G x G 2 (s)}U(z) 
and the pulse transfer function is 



Xo_ 

u 



(z) = G l G 2 (z) 



(7.29) 



(7.30) 



Note that G l {z)G 2 {z) + G x G 2 {z). 



Example 7.3 (See also Appendix 1, examp73.m) 

A first-order sampled-data system is shown in Figure 7.10. 

Find the pulse transfer function and hence calculate the response to a unit step and 

unit ramp. T = 0.5 seconds. Compare the results with the continuous system 

response x (t). The system is of the type shown in Figure 7.9(b) and therefore 



Inserting values 



G(s) = G l G 2 (s) 



G(s) = (| - e - r '>{*Ti)} 



(7.31) 
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X(S) 




Fig. 7.10 First-order sampled-data system. 



Taking z- transforms using Table 7.1. 



10- 1)0 -e r )J 



or 



G(z) 



(¥){, 



z(l 



l)(z 



which gives 



For r = 0.5 seconds 



hence 



G(z) 



G(z) = 



X 



(Z): 



1 -e- 



0.393 
- 0.607 



0.393z- 



Xi v_/ V 1 - 0.607Z- 1 
which is converted into a difference equation 

x (^r) = 0.607x o (£ - \)T + 0.393xi(A; - 1)T 



(7.32) 



(7.33) 



(7.34) 



(7.35) 



(7.36) 



(7.37) 



Table 7.2 shows the discrete response x (kT) to a unit step function and is compared 
with the continuous response (equation 3.29) where 



x (t) = (1 - e~0 



(7.38) 



From Table 7.2, it can be seen that the discrete and continuous step response is 
identical. Table 7.3 shows the discrete response x(kT) and continuous response x(t) 
to a unit ramp function where x (t) is calculated from equation (3.39) 



*o(0 — t — 1 + e 



(7.39) 



In Table 7.3 the difference between x (kT) and x (t) is due to the sample and hold. 
It should also be noted that with the discrete response x(kT), there is only knowledge 
of the output at the sampling instant. 
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Table 7.2 Comparison between discrete and continuous step response 



k 


kT (seconds) 


Xl (kT) 


XoikT) 


x (t) 


-1 


-0.5 

















1 








1 


0.5 


1 


0.393 


0.393 


2 


1.0 


1 


0.632 


0.632 


3 


1.5 


1 


0.776 


0.776 


4 


2.0 


1 


0.864 


0.864 


5 


2.5 


1 


0.918 


0.918 


6 


3.0 


1 


0.950 


0.950 


7 


3.5 


1 


0.970 


0.970 


8 


4.0 


1 


0.982 


0.982 


Table 7.3 


Comparison between 


discrete and continuous ramp response 


k 


kT (seconds) 


Xi (kT) 


XoikT) 


x (t) 


-1 


-0.5 


























1 


0.5 


0.5 





0.107 


2 


1.0 


1.0 


0.304 


0.368 


3 


1.5 


1.5 


0.577 


0.723 


4 


2.0 


2.0 


0.940 


1.135 


5 


2.5 


2.5 


1.357 


1.582 


6 


3.0 


3.0 


1.805 


2.050 


7 


3.5 


3.5 


2.275 


2.530 


8 


4.0 


4.0 


2.757 


3.018 



7.4.3 The closed-loop pulse transfer function 



Consider the error sampled system shown in Figure 7.11. Since there is no sampler 
between G(s) and H(s) in the closed-loop system shown in Figure 7.11, it is a similar 
arrangement to that shown in Figure 7.9(b). From equation (4.4), the closed-loop 
pulse transfer function can be written as 



In equation (7.40) 



£ G(z) 

R {Z> \+GH{z) 



GH(z) = Z{GH(s)} 



(7.40) 



(7.41) 



R(s) 


A 


> 


E(s) 


_^>x 


E*(s) 


G(s) 




C(s) 




9 




T 






► ► 
















H(<^ 
















n{s 


=7 









Fig. 7.11 Closed-loop error sampled system. 
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R(s) 


-*8>- 

- ▲ 


EM ^>< 


E*(s) 


G(s) 


C < s )-^r 


C*(s) 
b b> 




t 

T 


► 


r 










^ 






H(s) 



















Fig. 7.12 Closed-loop error and output sampled system. 



Consider the error and output sampled system shown in Figure 7.12. In Figure 7.12, 
there is now a sampler between G(s) and H(s), which is similar to Figure 7.9(a). From 
equation (4.4), the closed-loop pulse transfer function is now written as 



C G(z) 

R {Z) 1 + G(z)77(z) 



(7.42) 



7.5 Digital control systems 

From Figure 7.1, a digital control system may be represented by the block diagram 
shown in Figure 7.13. 

Example 7.4 (See also Appendix 1, examp74.m) 

Figure 7.14 shows a digital control system. When the controller gain ^is unity and 

the sampling time is 0.5 seconds, determine 

(a) the open-loop pulse transfer function 

(b) the closed-loop pulse transfer function 

(c) the difference equation for the discrete time response 

(d) a sketch of the unit step response assuming zero initial conditions 

(e) the steady-state value of the system output 






T 



e*(t) 



Digital 
Controller 



u*(t) 

► 



Zero 
Order 
Hold 



\u(t) 



Plant 



f ► 



microprocessor 



i_ i 



Sensor 



C(t) 



Fig. 7.13 Digital control system. 
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R(s) + 

i 


"> J>* h 


K 




1-e" Ts 
s 




1 

s(s+2) 




C(s) 


y 

7=0.5 



























Fig. 7.14 Digital control system for Example 7.4. 



Solution 



(a) G(s) = K 



Given 7£ = 1 



1 - Q~ Ts \ f 1 



s / (^(s + 2) 



GW =<'- e - r '>kW 



Partial fraction expansion 



1 



(A B C 1 

l7 + ? + (7T2)J 



or 



s 2 C? + 2) \ j s 2 

1 = j(j + 2M + + 2)B + s 2 C 



Equating coefficients gives 

z4 = -0.25 
£ = 0.5 
C = 0.25 

Substituting these values into equation (7.44) and (7.45) 

„,. H _ Ts , f-0.25 0.5 0.25 1 



or 



G(s) = 0.25 



(l-e-»){- 



1 2 1 

5 + ? + (5 + 2) 



Taking z-transforms 



G(z) = 0.25(1 -z- 



>{* 



-z 2Tz 



1) (z-l) 2 (z-e-^) 



Given 77 = 0.5 seconds 



„ , c /z-l\ f -1 2x0.5 1 

G(z) = 0.25(^)z|- 



z ; l(z-l) (z-l) 2 (z- 0.368) 



(7.43) 



(7.44) 



(7.45) 



(7.46) 



(7.47) 



(7.48) 



(7.49) 



(7.50) 
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Hence 

G(z) = 0.25(z - 1) 



G(z) = 



4 



-l(z - l)(z - 0.368) + (z - 0.368) + (z - l) 2 
(z - l) 2 (z - 0.368) 

z 2 + 1 .368z - 0.368 + z - 0.368 + z 2 - 2z + 1) 



(z - l)(z - 0.368) 
which simplifies to give the open-loop pulse transfer function 

0.092z + 0.066 



G(z) = 



1.368z + 0.368 



(7.51) 
(7.52) 

(7.53) 



Note: This result could also have been obtained at equation (7.44) by using z-trans- 
form number 7 in Table 7.1, but the solution demonstrates the use of partial frac- 
tions. 

(b) The closed-loop pulse transfer function, from equation (7.40) is 

( 0.092z+0.066 A 
\z 2 -l36Sz+036SJ 



C , N {z 2 -\.36Sz+0368) 



1 



0.092z+0.066 
z 2 -1.368z+0.368 



) 



(7.54) 



which simplifies to give the closed-loop pulse transfer function 



C 
R 



(z) 



0.092z + 0.066 

z 2 - 1.276z + 0.434 



or 



C 



-Xz) 



0.092z- 



0.066z- 



(7.55) 



(7.56) 



R y ~ y 1 - 1.276Z- 1 +0.434z- 2 

(c) Equation (7.56) can be expressed as a difference equation 

c(kT) = \216c(k - \)T - 0.434c(/c - 2)T + 0.092r(/c - \)T + 0.066r(/c - 2)T 

(7.57) 

(d) Using the difference equation (7.57), and assuming zero initial conditions, the 
unit step response is shown in Figure 7.15. 

Note that the response in Figure 7.15 is constructed solely from the knowledge of the 
two previous sampled outputs and the two previous sampled inputs. 

(e) Using the final value theorem given in equation (7.14) 

f z- 1\ C 



c(oo) = lim 

Z->1 



R 



(z)R(z) 



c(oo) = lim 

Z->1 



Z- 1 



0.092z + 0.066 
1 - 1.276z + 0.434l Vz 



4t) 



(7.58) 
(7.59) 
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c(kT) 



-\ . 




















8 - 




















n fi - 




















n a - 




















n 9 - 




















0< 





















0.5 1 1.5 2 2.5 3 3.5 4 4.5 kT 

Fig. 7.15 Unit step response for Example 7.4. 



c(oo) = 



0.092 + 0.066 



v l - 1.276 + 0.434 
Hence there is no steady-state error. 



= 1.0 



(7.60) 



tability in the z-plane 
7.6.1 Mapping from the s-plane into the z-plane 

Just as transient analysis of continuous systems may be undertaken in the s-plane, 
stability and transient analysis on discrete systems may be conducted in the z-plane. 
It is possible to map from the s to the z-plane using the relationship 



a sT 



(7.61) 



now 



therefore 



s = a ± jcj 



z = e ((J±Ja;):r = e aT e jcjT (using the positive jcj value) 



(7.62) 
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Im 




ZZ = ujT=2ttuj/u;s 



Re 



Fig. 7.16 Mapping from the s to the z-plane. 



Ife' 



sjT 



\z\ and T = 2ir/uj s equation (7.62) can be written 



z = |z|e j(27rc ^ s) 



(7.63) 



where cj s is the sampling frequency. 

Equation (7.63) results in a polar diagram in the z-plane as shown in Figure 7.16. 
Figure 7.17 shows mapping of lines of constant a (i.e. constant settling time) from the 
s to the z-plane. From Figure 7.17 it can be seen that the left-hand side (stable) of the 
s-plane corresponds to a region within a circle of unity radius (the unit circle) in the z- 
plane. 

Figure 7.18 shows mapping of lines of constant u (i.e. constant transient fre- 
quency) from the s to the z-plane. 



(a) 






(b) (c) 



a=0 



UJs 

2 



-LPs 

2 



s-plane 
Fig. 7.17 Mapping constants from s to z-plane. 




LJ __us stable region 
4 



z-plane 
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8 



s-plane 
Fig. 7.18 Mapping constant uj from s to z-plane. 




z-plane 



\UJ 







8 


9f 10 


5 


6 t 7 


1 2 


3 4 cr 


5 


6 7 


8 


9 10 




s-plane 
Fig. 7.19 Corresponding pole locations on both sand z-planes. 



z-plane 



4 Re 



Figure 7.19 shows corresponding pole locations on both the s-plane and z-plane. 



7.6.2 The Jury stability test 

In the same way that the Routh-Hurwitz criterion offers a simple method of 
determining the stability of continuous systems, the Jury (1958) stability test is 
employed in a similar manner to assess the stability of discrete systems. 
Consider the characteristic equation of a sampled-data system 



Q{z) = a n z n + a n -i 



n-\ 



- CL\1 



cio = 



(7.64) 
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Table 7.4 Jury's array 



z° 


z i 


z 2 


Z n-X 


-a 


a 


a\ 


a 2 


a n -x 


a n 


a n 


a n -\ 


a n -2 


a x 


a Q 


bo 


bx 


b 2 


■ ■ Vi 




K-x 


b n -2 


b n -3 ■ 


• • b 




h 


h 


h 


.. h 




h 


h 


h 


.. k 




m Q 


m x 


m 2 






m 2 


m\ 


m 







The array for the Jury stability test is given in Table 7.4 where 

b k 



ao a n -k 
a n ak 



Ck 



dh 



bo b n -\-k 

A/i-i h 

CO C n _2-k 

C n -2 C k 



(7.65) 



The necessary and sufficient conditions for the polynomial Q(z) to have no roots 
outside or on the unit circle are 

Condition 1 g(l) > 
Condition 2 (-If g(-l) > 
Condition 3 \oq\ < a n 

|6o|>|Vi| 

ko| > \Cn-l\ 



(7.66) 



Condition n \mo\ > \rri2\ 



Example 7.5 (See also Appendix 1, examp75.m) 

For the system given in Figure 7.14 (i.e. Example 7.4) find the value of the digital 
compensator gain K to make the system just unstable. For Example 7.4, the char- 
acteristic equation is 

1 + G(z) = (7.67) 



In Example 7.4, the solution was found assuming that K 
equation (7.53), the characteristic equation is 



1 



K(0.092z + 0.066) 
(z 2 - 1.368z + 0.368) 







1. Therefore, using 



(7.68) 
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or 



Q(z) = z 2 + (0.092i: - 1.368)z + (0.368 + 0.066X) = 
The first row of Jury's array is 



ji 



(0.368 + 0.066*) (0.092* - 1 .368) 1 



(7.69) 



(7.70) 



Condition 1: 20) > 
From equation (7.69) 

2(1) = {1 + (0.092* - 1.368) + (0.368 + 0.066*)} > 

From equation (7.71), 2(1) > if * > 0. 

Condition 2 (-1)"Q(-1) > 

From equation (7.69), when n = 2 

(-1) 2 2(-1) = {1 - (0.092* - 1.368) + (0.368 + 0.066*)} > 
Equation (7.72) simplifies to give 

2.736 - 0.026* > 



or 



*<*£-«*» 



/ K=9.58 



(7.71) 



(7.72) 



(7.73) 




Fig. 7.20 Root locus diagram for Example 7.4. 
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Condition 3: \a$\ < <22 

|0.368 + 0.066^| < 1 (7.74) 

For marginal stability 

0.368 + 0.0667r= 1 

1-0.368 ( 7 - 75 ) 

^-^06^- 9 - 58 

Hence the system is marginally stable when K = 9.58 and 105.23 (see also Example 
7.6 and Figure 7.20). 

7.6.3 Root locus analysis in the z-plane 

As with the continuous systems described in Chapter 5, the root locus of a discrete 
system is a plot of the locus of the roots of the characteristic equation 

1 + GH(z) = (7.76) 

in the z-plane as a function of the open-loop gain constant K. The closed-loop system 
will remain stable providing the loci remain within the unit circle. 

7.6.4 Root locus construction rules 



These are similar to those given in section 5.3.4 for continuous systems. 

1. Starting points (K = 0): The root loci start at the open-loop poles. 

2. Termination points (K = oo): The root loci terminate at the open-loop zeros when 
they exist, otherwise at oo. 

3. Number of distinct root loci: This is equal to the order of the characteristic 
equation. 

4. Symmetry of root loci: The root loci are symmetrical about the real axis. 

5. Root locus locations on real axis: A point on the real axis is part of the loci if the 
sum of the open-loop poles and zeros to the right of the point concerned is odd. 

6. Breakaway points: The points at which a locus breaks away from the real axis can 
be found by obtaining the roots of the equation 

±{GH(z)} = 

7. Unit circle crossover: This can be obtained by determining the value of K for 
marginal stability using the Jury test, and substituting it in the characteristic 
equation (7.76). 

Example 7.6 (See also Appendix 1, examp76.m) 

Sketch the root locus diagram for Example 7.4, shown in Figure 7.14. Determine the 

breakaway points, the value of K for marginal stability and the unit circle crossover. 
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G(s) = K[\-~—\[-r^rs) ( 7 - 77 ) 



'('-?){; 



14* + 2) 
and from equation (7.53), given that T = 0.5 seconds 



Open-loop poles 



Open-loop zeros 



<*>=*i ^::l > 



z 2 -1.368z + 0.368 = (7.79) 

z = 0.684 ±0.316 
= 1 and 0.368 (7.80) 

0.092z + 0.066 = 



z = -0.717 (7.81) 

From equations (7.67), (7.68) and (7.69) the characteristic equation is 

z 2 + (0.092^ - 1 .368)z + (0.368 + 0.066^) = (7.82) 

Breakaway points: Using Rule 6 

±{GH( Z)} = 

(z 2 - 1 .368z + 0.368)^(0.092) - ^(0.092z + 0.066)(2z - 1 .368) = (7.83) 

which gives 

0.092z 2 + 0.132z- 0.1239 = 

z = 0.647 and -2.084 (7.84) 

Kfor marginal stability: Using the Jury test, the values of K as the locus crosses the 
unit circle are given in equations (7.75) and (7.73) 

K = 9.58 and 105.23 (7.85) 

Unit circle crossover: Inserting K = 9.58 into the characteristic equation (7.82) gives 

z 2 - 0.487z +1=0 (7.86) 

The roots of equation (7.86) are 

z = 0.244 ±j0.97 (7.87) 

or 

z= 1Z±75.9° = lZ±1.33rad (7.88) 
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Since from equation (7.63) and Figure 7.16 

z = \z\ IujT (7.89) 

and T = 0.5, then the frequency of oscillation at the onset of instability is 

0.5cj= 1.33 

(7.90) 
uj = 2.66rad/s 

The root locus diagram is shown in Figure 7.20. 

It can be seen from Figure 7.20 that the complex loci form a circle. This is usually 
the case for second-order plant, where 

Radius = Y^ | open-loop poles | 

Centre = (Open-loop zero, 0) (7.91) 

The step response shown in Figure 7.15 is for K= 1. Inserting K= 1 into the 
characteristic equation gives 

z 2 - 1.276z + 0.434 = 

or 

z = 0.638 ±j0.164 

This position is shown in Figure 7.20. The K values at the breakaway points are also 
shown in Figure 7.20. 



7.7 Digital compensator design 



In sections 5.4 and 6.6, compensator design in the s-plane and the frequency domain 
were discussed for continuous systems. In the same manner, digital compensators 
may be designed in the z-plane for discrete systems. 

Figure 7.13 shows the general form of a digital control system. The pulse transfer 
function of the digital controller/compensator is written 

|(z) = Z)(z) (7.92) 

and the closed-loop pulse transfer function become 

C D(z)G(z) 

^ = unnrffn (793) 

R 1 + D(z)GH(z) 

and hence the characteristic equation is 

1 + D(z)GH(z) = (7.94) 
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7.7.1 Digital compensator types 

In a continuous system, a differentiation of the error signal e can be represented as 

u(t) = - 
Taking Laplace transforms with zero initial conditions 

§(■*) = ■* (7.95) 

In a discrete system, a differentiation can be approximated to 

e(kT)-e(k-l)T 
u(kT) = 

hence 

U \-z~ x 

^ z ) = —r~ (7 - 96) 



Hence, the Laplace operator can be approximated to 

1-z- 1 z-1 



Tz 



(7.97) 



Digital PID controller. From equation (4.92), a continuous PID controller can be 
written as 

U ATKW + 7,,+ 1) 

E KJ T { s y } 

Inserting equation (7.97) into (7.98) gives 



which can be simplified to give 



£ Z(Z — 1) 



where 



/' 



2r d 



'i = ll-^H (7.101) 
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Justin's Rule'. Tustin's rule, also called the bilinear transformation, gives a better 
approximation to integration since it is based on a trapizoidal rather than a rect- 
angular area. Tustin's rule approximates the Laplace transform to 

$ = 7^7 7T (7.102) 

T(z+\) K } 

Inserting this value of s into the denominator of equation (7.98), still yields a digital 
PID controller of the form shown in equation (7.100) where 

u ( T 2T A \ 



Example 7.7 (See also Appendix 1, examp77.m) 

The laser guided missile shown in Figure 5.26 has an open-loop transfer function 

(combining the fin dynamics and missile dynamics) of 

G(sms) =wh) (7 - 104) 

A lead compensator, see case study Example 6.6, and equation (6.1 13) has a transfer 
function of 

0.8(1+ j) 
G{S) = (1+0.0625.) (7 ' 105) 

(a) Find the z-transform of the missile by selecting a sampling frequency of at least 
10 times higher than the system bandwidth. 

(b) Convert the lead compensator in equation (7.105) into a digital compensator 
using the simple method, i.e. equation (7.97) and find the step response of the 
system. 

(c) Convert the lead compensator in equation (7.105) into a digital compen- 
sator using Tustin's rule, i.e. equation (7.102) and find the step response of the 
system. 

(d) Compare the responses found in (b) and (c) with the continuous step response, 
and convert the compensator that is closest to this into a difference equation. 

Solution 

(a) From Figure 6.39, lead compensator two, the bandwidth is 5.09rad/s, or 
0.81 Hz. Ten times this is 8.1 Hz, so select a sampling frequency of 10 Hz, i.e. 
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T = 0.l seconds. For a sample and hold device cascaded with the missile 
dynamics 

(\ -e _m 
G(s) 



V(5 + 5)J 
\7(, 



^ ) = (1 - e " r ^^ + 5)j 

For T = 0.1, equation (7.107) has a z- transform of 

0.00296z 2 + 0.01048z + 0.0023 
G(z) 



z 3 - 2.6065z 2 + 2.2131z - 0.6065 



(7.106) 
(7.107) 

(7.108) 



(b) Substituting 



z- 1 
Tz 



into lead compensator given in equation (7.105) to obtain digital compensator 

£>(z) = 0.8< 
This simplifies to give 



Tz+(z-X) 1 
rz+0.0625(z-l) I 



D(z) 



5.4152z- 4.923 
z- 0.3846 



(7.109) 



(c) Using Tustin's rule 



2(z ~ 1) 
T(z+\) 



Substituting into lead compensator 

D(z) = 0.8 

This simplifies to give 

D(z) = 



r(z+i)+2(z-i) 

T{z+\) 



r(z+l)+0.0625{2(z-l)} 



r(z+i) 



7.467z - 6.756 
z- 0.111 



(7.110) 



(d) From Figure 7.21, it can be seen that the digital compensator formed using 
Tustin's rule is closest to the continuous response. From equation (7.110) 



U 7.467 - 6.756Z- 1 

is ~ 1 -O.lllz- 1 



(7.111) 
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Continuous 

Simple method 
Tustin's rule 




Fig. 7.21 Comparison between discrete and continuous response. 



4 4.5 5 

AT (seconds) 



Hence the difference equation for the digital compensator is 

u(kT) = O.Ulu(k - \)T + 7A67e(kT) - 6J56e(k - \)T 



(7.112) 



7.7.2 Digital compensator design using pole placement 



Case study 

Example 7.8 (See also Appendix 1, examp78.m) 

The continuous control system shown in Figure 7.22(a) is to be replaced by the digital 

control system shown in Figure 7.22(b). 

(a) For the continuous system, find the value of K that gives the system a damping 
ratio of 0.5. Determine the closed-loop poles in the s-plane and hence the values 
of a and lj. 

(b) Find the closed-loop bandwidth uj^ and make the sampling frequency uo s a factor 
of 10 higher. What is the value of 77 

(c) For the sampled system shown in Figure 7.22(b), find the open-loop pulse trans- 
fer function G(z) when the sample and hold device is in cascade with the plant. 

(d) With D(z) set to the value of K found in (a), compare the continuous and discrete 
step responses. 
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R(s) 



■X 







^ 


3 






7) > 


K 


C(s) 






s(s+1) 


< 


> ► 













R{s) 











1-e- Ts 
s 




3 
s(s+1) 




y-^r- 


— ► 


D(z) 


C(s) 








w 

















(b) 

Fig. 7.22 Continuous and digital control systems. 

(e) By mapping the closed-loop poles from the s to the z-plane, design a compensator 
D(z) such that both continuous and sampled system have identical closed-loop 
response, i.e. ( = 0.5. 

Solution 

(a) The root-locus diagram for the continuous system in shown in Figure 7.23. From 
Figure 7.23 the closed-loop poles are 



-0.5±j0.866 



(7.113) 



or 

a= -0.5, co = 0.866 rad/s 

and the value of K is 0.336. 

(b) Plotting the closed-loop frequency response for the continuous system gives a 
bandwidth uo^ of 1.29rad/s(0.205Hz). The sampling frequency should therefore 
be a factor of 10 higher, i.e. 12.9rad/s(2.05Hz). Rounding down to 2.0 Hz gives 
a sampling time T of 0.5 seconds. 

"3 



(c) 



G(z) = (l -z~ l )Z 



s*(s+l) 



(7.114) 



Using transform 7 in Table 7.1 



G(z) 



3{(e 



-0.5 



0.5)z + (l-1.5e-°- 5 )} 



(z-l)(z-e-°- 5 ) 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC07.3D - 226 - [198-231/34] 9.8.2001 2:33PM 



226 Advanced Control Engineering 




Fig. 7.23 Root locus diagram for continuous system. 

Hence 

0.3196(z + 0.8467) 



G(z) 



(z - l)(z - 0.6065) 



(7.115) 



(d) With D(z) = K = 0.336, the difference between the continuous and discrete step 
response can be seen in Figure 7.24. 

(e) Mapping closed-loop poles from s to z-plane 



oT 



inserting values 



z = e' 



\z\ = e -°- 5x0 - 5 = 0.779 



Lz = loT 

= 0.866 x 0.5 = 0.433 rad 

= 24.8° 



(7.116) 



(7.117) 



Converting from polar to cartesian co-ordinates gives the closed-loop poles in the z- 
plane 



z = 0.707 ±j0.327 
which provides a z-plane characteristic equation 

z 2 - 1.414z + 0.607 = 



(7.118) 



(7.119) 
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Discrete 
Continuous 




9 10 

t, kT (seconds) 



Fig. 7.24 Continuous and digital controllers set to K = 0.336. 



The control problem is to design a compensator D(z), which, when cascaded with 
G(z), provides a characteristic equation 



1 + D(z)G(z) = 



(7.120) 



such that the equations (7.119) and (7.120) are identical. Let the compensator be of 
the form 



D{z) 



K(z - a) 



(z + b) 
Select the value of a so that the non-unity pole in G(z) is cancelled 

_ K ^ z ~ °- 6065 ) 0-3196(z + 0.8467) 
(z) (z)- (z + z?) ( z - l)(z - 0.6065) 

Hence the characteristic equation (7.120) becomes 

0.3196^(z + 0.8467) _ 

+ " ( Z + Z , )(z _i) " 

which simplifies to give 

z 2 + (0.3196^ + b - \)z + (0.2706^ - b) = 



(7.121) 



(7.122) 



(7.123) 
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1.4 



Continuous 
and Discrete 




8 9 10 

t, kT (seconds) 



Fig. 7.25 Identical continuous and discrete step responses as a result of pole placement. 

Equating coefficients in equations (7.119) and (7.123) gives 

0.3196^ + 6- 1 = -1.414 
0.2706^ -b = 0.607 



(7.124) 

(7.125) 



Add 0.5902A:- 1 



= -0.807 



or 



0.5902^ = 0.193 
K = 0.327 

Inserting equation (7.126) into (7.125) 

(0.2706 x 0.327) - 0.607 = b 
A = -0.519 

Thus the required compensator is 

U 0.327(z- 0.6065) 

D ^ = E (Z) = (z- 0.519) 



(7.126) 



(7.127) 



(7.128) 



Figure 7.25 shows that the continuous and discrete responses are identical, both with 
C = 0.5. The control algorithm can be implemented as a difference equation 



-(z) = 0.327 (1 _ 0519z _ 1} 



(7.129) 



hence 



u(kT) = 0327e(kT) - 0.1983e(£ - \)T + 0.519w(/c - \)T 



(7.130) 
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7.8 Further problems 



Example 7.9 

Assuming that a sample and hold device is in cascade with the transfer function G(s), 

determine G(z) for the following 



(a) G(s) 

(b) G(s) = 

(c) G(s) = 

Solution 

(a) G(z) : 

(b) G(z) 

(c) G(z) : 



1 



(J+1) 



0+l)(s + 2)' 

1 



^0 + 0.5)' 



T 7 = 0.1 seconds 

r = 0.5 seconds 
T = 1.0 seconds 



0.095 
z- 0.905 

0.155(z + 0.606) 
: z 2 - 0.974z + 0.223 

0.426(z + 0.847) 
z 2 -1.607z + 0.607 



Example 7.10 

The computer control system shown in Figure 7.26 has a sampling time of 0.5 

seconds 

(a) Find the open-loop pulse transfer function G(z) and hence determine the open- 
loop poles and zeros for the combined sample and hold and the plant. 

(b) From (a) evaluate the difference equation relating c(kT), c(k — l)T, c(k — 2)T, 
u(k- 1)T andu(k-2)T. 

(c) If the computer has the control algorithm 

u(kT) = 1.5e(kT) 



Plant 



R(s) 





Computer 






^ 


ridi u 






1-e- Ts 
s 


2 
s(s+4) 




^ T 


K 


C(s) 


► 






t — w 















Fig. 7.26 Computer control system for Example 7.10. 
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using a tabular approach, calcuate the system response when the input is a unit 
step applied at kT = for the discrete time values of kT = 0, 0.5, 1.0, 1.5, 2.0 and 
2.5 seconds. Assume that at kT less than zero, all values of input and output 
are zero. 

Solution 

0.1419(z + 0.523) 



(a) G(z) 



z 2 - 1.135z + 0.135 
poles z= 1,0.135 
zeros z = -0.523 

(b) c(kT) = \A35c(k - \)T - 0.135c(£ - 2)T + 0.1419w(£ - \)T + 0.0743w(£ - 2)T 

(c) kT 0.5 1.0 1.5 2.0 2.5 
c(kT) 0.213 0.521 0.752 0.889 0.959 

Example 7.11 

A unity feedback computer control system, has an open-loop pulse transfer function 

„, , 0.426^(z + 0.847) 
G(z) 



z 2 -1.607z + 0.607 



(a) Determine the open-loop poles and zeros, the characteristic equation and break- 
away points. 

(b) Using the Jury test, determine the value of K at the unit-circle crossover points. 

(c) Find the radius and centre of the circular complex loci, and hence sketch the root 
locus in the z-plane. 

Solution 

(a) poles z= 1,0.607 
zeros z = -0.847 

z 2 + (0.426^ - 1.607)z + (0.361^ + 0.607) = 
breakaway points z = 0.795, —2.5 

(b) K= 1.06,47.9 

(c) radius = 1.607, centre = -0.847, 

Example 7.12 

A unity feedback continuous control system has a forward-path transfer function 

G(s) K 



s(s + 5) 



(a) Find the value of K to give the closed-loop system a damping ratio of 0.7. The 
above system is to be replaced by a discrete-time unity feedback control system 
with a forward-path transfer function 
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1 _ e -Ts\ / I 



s(s + 5) 



(b) If the sampling time is 0.2 seconds, determine the open-loop pulse transfer 
function. 

(c) The discrete-time system is to have the identical time response to the continuous 
system. What are the desired closed-loop poles and characteristic equations in 

(i) the s-plane 
(ii) the z-plane 

(d) The discrete-time compensator is to take the form 

(z + b) 
Find the values of K\ and b if a is selected to cancel the non-unity open-loop pole. 

Solution 

(a) K= 12.8 

0.0147(z + 0.718) 

(b) ° (Z) = (z-l)(z- 0.368) 

(c) -2.48 ± J2.56, s 1 + 5s + 12.8 = 
0.531 ± jO.298, z 2 - 1.062z + 0.371 = 
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State-space methods for 
control system design 



8.1 The state-space-approach 

The classical control system design techniques discussed in Chapters 5-7 are gener- 
ally only applicable to 

(a) Single Input, Single Output (SISO) systems 

(b) Systems that are linear (or can be linearized) and are time invariant (have 
parameters that do not vary with time). 

The state-space approach is a generalized time-domain method for modelling, ana- 
lysing and designing a wide range of control systems and is particularly well suited to 
digital computational techniques. The approach can deal with 

(a) Multiple Input, Multiple Output (MIMO) systems, or multivariable systems 

(b) Non-linear and time-variant systems 

(c) Alternative controller design approaches. 



8.1.1 The concept of state 

The state of a system may be defined as: 'The set of variables (called the state 
variables) which at some initial time t , together with the input variables completely 
determine the behaviour of the system for time t > t$\ 

The state variables are the smallest number of states that are required to describe 
the dynamic nature of the system, and it is not a necessary constraint that they are 
measurable. The manner in which the state variables change as a function of time 
may be thought of as a trajectory in n dimensional space, called the state-space. 
Two-dimensional state-space is sometimes referred to as the phase-plane when one 
state is the derivative of the other. 
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8.1.2 The state vector differential equation 

The state of a system is described by a set of first-order differential equations in terms 
of the state variables (x\ 9 x 29 • • • , x n ) and input variables (u\, U2, . . . , u n ) in the 
general form 



Ax\ 

~df 
dx2 

dx n 
~df 



a n x\ + anx 2 H h a\ n x n + Anwi H h &i w w w 

«2lXi + <222^2 H h ^2«^« + ^21 Ml H h &2m^ 

<2„iXi + <2„2*2 H + ci nn x n + b n \u\-\ h b nm u n 



(8.1) 



The equations set (8.1) may be combined in matrix format. This results in the state 
vector differential equation 



x = Ax + Bu 



(8.2) 



Equation (8.2) is generally called the state equation(s), where lower-case boldface 
represents vectors and upper-case boldface represents matrices. Thus 



x is the n dimensional state vector 



u is the m dimensional input vector 



X\ 

x 2 

x n 



U2 



A is the n x n system matrix 



a u a n 
an ail 



B is the n x m control matrix 



Clin 



&n\ &n2 - - - &n. 



bu 
b 2 \ 



b\ m 
blm 



(8.3) 



(8.4) 



(8.5) 



(8.6) 



b„\ ... b„ 
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y y y 



(a) 



Fig. 8.1 Spring-mass-damper system and free-body diagram. 



(b) 



In general, the outputs ( y\, y 2 , . . . , y n ) of a linear system can be related to the state 
variables and the input variables 



y = Cx + Du 

Equation (8.7) is called the output equation(s). 



(8.7) 



Example 8.1 

Write down the state equation and output equation for the spring-mass-damper 

system shown in Figure 8.1(a). 



Solution 
State variables 



Input variable 



Now 



From Figure 8.1(b) 



or 



xi=y 
dy . 

X2 = d7 = Xl 



u = P(t) 

^F y = my 

Pit) - Ky - Cy = my 



dy k c . l , , 

at 1 m m m 



(8.8) 
(8.9) 

(8.10) 



(8.11) 
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From equations (8.9), (8.10) and (8.11) the set of first-order differential equations are 

X\ = X2 



K C 1 

X2 = X\ X2 H U 



m m 

and the state equations become 

1 

K _C 
m m 

From equation (8.8) the output equation is 

y = [\ 0] 



m 



x\ 

*2 



X\ 

X2 



X\ 

X2 



(8.12) 



(8.13) 



(8.14) 



State variables are not unique, and may be selected to suit the problem being studied. 

Example 8.2 

For the RCL network shown in Figure 8.2, write down the state equations when 

(a) the state variables are V2(0 and 1)2 

(b) the state variables are V2(0 and i(i). 



Solution 
(a) 

From equation (2.37) 



LC 



x\ = v 2 (0 

Xl = V2 = X\ 

d 2 V2 ^^dv 2 

^ + ^C- + v 2 = v l( 



(8.15) 



(8.16) 



From equations (8.15) and (8.16) the set of first-order differential equations are 

X\ = X2 



xi 



1 



RC 



1 



LC Xl -LC X2+ LC U 



(8.17) 



v,(f) 



-^ny^y^r- 



Kt) 



vM 



Fig. 8.2 RCL network. 
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and the state equations are 



x 2 



x\ 

x 2 



1 

1 -R 
L ~LC ~L~ 
(b) *i = v 2 (0 

X2 = i(t) 

From equations (2.34) and (2.35) 

di 
L—=-v 2 (t)-Ri(i) + v x (i) 

dt A 





1 

LC 



(8.18) 
(8.19) 

(8.20) 
(8.21) 



Equations (8.20) and (8.21) are both first-order differential equations, and can be 
written in the form 

1 

X7 

(8.22) 



giving the state equations 



X\ 

x 2 



X\ 

x 2 


= c X2 

1 R 
= -L Xl ~L 


x 2 + 


1 

T 




= 


" 1 " 
1 R 

_~z ~z_ 




x\ 


+ 


"0 

i 
_Z 



(8.23) 



Example 8.3 

For the 2 mass system shown in Figure 8.3, find the state and output equation when 

the state variables are the position and velocity of each mass. 



Solution 
State variables 



System outputs 
System inputs 

For mass m\ 
For mass m 2 



x\ =y\ x 2 = y\ 

X3 =yi x 4 = y 2 



yuyi 

u = P(t) 



^F y =m l y l 
K 2 (y 2 - y\) - K x y x + P(t) - C\y\ = m x y x 

^F y = m 2 y 2 
- K 2 (y 2 -y x ) = m 2 y 2 



(8.24) 



(8.25) 



(8.26) 
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////// ////// //////// 



y,(t)\ 




▲ 


3 (f) Ciyi 

1 1 


m i 




▼ 





yi,yi.yi 



y 2 >yi 



^ 2 (y 2 -yi) 



y2,y 2 ,y2 



(a) (b) 

Fig. 8.3 Two-mass system and free-body diagrams. 

From (8.24), (8.25) and (8.26), the four first-order differential equations are 

X\ = X 2 

x 2 = 



K x K 2 \ d 

)xi x 2 

m\ m\) m\ 



K 2 



1 



ni\ 



-X3 



nil 



(8.27) 



X 3 = X4 

K 2 K 2 

X4 = X\ X 3 

m 2 m 2 



Hence the state equations are 







Xi 




x 2 





x 3 




X4 






K x + K 2 

m\ 

^2 

m 2 



1 

C K 2 





m 2 













r ° 1 




X\ 




1 




Xi 




— 




x 3 


+ 







X4 












L u J 



(8.28) 



and the output equations are 



yi 



1000" 

10 




~X\~ 

x 2 
x 3 
X4 



(8.29) 
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U(s) 


b n -<\ s n 1 +■■■ + b<\ s + b 


Y(s) 








s n + a n -<\ s + ■■■+ a^s+ a Q 





Fig. 8.4 Generalized transfer function. 

8.1.3 State equations from transfer functions 

Consider the general differential equation 

d n y d n ~ l y dy d n ~ l u du 

^ + ^- 1 d^ + --- + " 1 ^ + w = ^- 1 d^ + --- + Z?1 d7 + M (8 - 30) 

Equation (8.30) can be represented by the transfer function shown in Figure 8.4. 
Define a set of state variables such that 



X\ = X2 








x 2 = x 3 








X n = —(2qX\ - 


- <2\X2 — • 


• -a n - 


\X n +u 



and an output equation 



y = b x\ + b\x 2 -\ h b n -\x n 



Then the state equation is 



X n -l 

A;/ 



1 






— Qq —Q\ —Cl2 



1 




Xi 




r°i 







x 2 


+ 





1 




X n -1 







— a n -\ - 




X n 




L i J 



(8.31) 



(8.32) 



(8.33) 



The state-space representation in equation (8.33) is called the controllable canonical 
form and the output equation is 



y = [b b x b 2 ... b n - X ] 



Example 8.4 (See also Appendix 1, examp84.m) 
Find the state and output equations for 



x\ 

X2 
X3 



(8.34) 



U 



(s) 



s 3 + 3s 2 + 6s + 2 
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State equation 



Output equation 
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X\ 

x 2 
x 3 






1 


" 




~X\~ 




"0" 








1 




x 2 


+ 





-2 


-6 


-3 




_ X 3_ 




1 



y = [4 0] 



X\ 

x 2 
x 3 



Example 8.5 

Find the state and output equations for 



Y 



-M 



5s 2 + 7s + 4 



U s 3 + 3s 2 + 6^ + 2 

Solution 

The state equation is the same as (8.35). The output equation is 



y = [4 1 5] 



X\ 

x 2 
x 3 



5.35) 



(8.36) 



(8.37) 



8.2 Solution of the state vector differential equation 



Consider the first-order differential equation 

dx 



At 



ax(t) + bu(t) 



where x(i) and u(t) are scalar functions of time. Take Laplace transforms 

sX(s) - x(0) = aX(s) + bU(s) 
where x(0) is the initial condition. From equation (8.39) 

x(0) , 



X(s) 



(s — a) (s — a) 



U(s) 



Inverse transform 



x(t) = e at x(0) + f e a( '- T) bu(T)di 
Jo 



(8.38) 



(8.39) 



(8.40) 



(8.41) 



where the integral term in equation (8.41) is the convolution integral and r is a 
dummy time variable. Note that 



1 +at 



2! 



a k t k 
Id 



(8.42) 
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Consider now the state vector differential equation 

x = Ax + Bu (8.43) 

Taking Laplace transforms 

sX(s) - x(0) = AXO) + BU(j) (8.44) 

(si - A)X(s) = x(0) + BU(j) 
Pre-multiplying by (si — A) -1 

X(s) = (si - A) _1 x(0) + (si - A)- l BU(s) (8.45) 

Inverse transform 

x(0 = Q At x(0) + / e A( '- r) BU(r)dr (8.46) 

Jo 

if the initial time is to, then 

x(0 = e A( '-' o) x(0) + / e A(? - r) Bu(r)dr (8.47) 

Jt 

The exponential matrix e At in equation (8.46) is called the state-transition matrix 0(0 
and represents the natural response of the system. Hence 

0(s) = (si - A) -1 (8.48) 

0(0 = £?-\sl - A) -1 = e A ' (8.49) 



(8.50) 



x(0 = O(0x(0) + [ Q(t- r)Bu(r)dr (8.51) 

Jo 

In equation (8.51) the first term represents the response to a set of initial conditions, 
whilst the integral term represents the response to a forcing function. 

Characteristic equation 

Using a state variable representation of a system, the characteristic equation is given 
by 

| (si - A) | = (8.52) 



Alternatively 




A 2 ? 2 
O(0 = I + A? + — +• 


A k t k 
+ kl 


Hence equation (8.46) can be written 
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1 








"0 


X] 










X] 








= 


K 


( 






+ 


1 


x 2 










x 2 










L m 


ml 








Vm 
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8.2.1 Transient solution from a set of initial conditions 

Example 8.6 

For the spring-mass-damper system given in Example 8.1, Figure 8.1, the state 

equations are shown in equation (8.13) 



(8.53) 



Given: aw = 1 kg, C = 3 Ns/m, K = 2N/m, u(t) = 0. Evaluate, 

(a) the characteristic equation, its roots, u n and ( 

(b) the transition matrices </>(s) and </>(t) 

(c) the transient response of the state variables from the set of initial conditions 

J(0) = 1.0, 
y(0) = 

Solution 

Since x\—y and x 2 = y, then x\(0) = 1.0, ^(O) = 0. 

Inserting values of system parameters into equation (8.53) gives 



X\ 

x 2 





-2 



1 



X\ 

x 2 



(a) 



(si -A) 



s 
s 



1 

-2 -3 



From equation (8.52), the characteristic equation is 

|(*I-A)|=4? + 3)-(-2) = s 2 - 



s -1 
2 (j + 3) 



3^ + 2 = 



Roots of characteristic equation 



-1,-2 



(8.54) 



(8.55) 



(8.56) 



Compare equation (8.55) with the denominator of the standard form in equation 
(3.43) 

u? n = 2 i.e uo n = 1.414rad/s 
2(uj u = 3 i.e C = 1-061 



(8.57) 



(b) The inverse of any matrix A (see equation A2.17) is 

! Adjoint A 



detA 



(8.58) 



From equation (8.48) 



Q>(s) = (si - A)' 
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Using the standard matrix operations given in Appendix 2, equation (A2.12) 

Minors of <3>(V) 



(J + 3) 2 
-1 s 



(J + 3) -2 
1 j 



Co-factors of 0(s) 

The Adjoint matrix is the transpose of the Co-factor matrix 

Adjoint of ®(s) 

Hence, from equations (8.58) and (8.48) 

_(s + 3) 



(s + 3) 1 

-2 s 



1 



(s+l)(s + 2) (s+l)(s + 2) 
-2 s 



_(s+l)(s + 2) (s+l)(s + 2)_ 
Using partial fraction expansions 

2 1 \ / 1 1 



(8.59) 



(8.60) 



0(s) 



-2 



s + 1 5+2 
1 1 



s+l s + 2 
1 2 



(8.61) 



(8.62) 



v ,?+l s + 2) \ s+l s + 2 
Inverse transform equation (8.61) 

K) [-2(e-'-e- 2 (-e-' + 2e- 2r ) 
Note that the exponential indices are the roots of the characteristic equation (8.56). 
(c) From equation (8.51), the transient response is given by 

x(0 = O(r)x(0) 



Hence 



x 2 



(2e- ? - e- 2 (e- ? - Q~ 2t ) 
-2(e- ? - e- 2 (-e-' + 2e~ 2 

xi(0 = (2e" r -e- 2 

x 2 (t) = -2(e~' - e~ 2 



(8.63) 

(8.64) 
(8.65) 



The time response of the state variables (i.e. position and velocity) together with the 
state trajectory is given in Figure 8.5. 

Example 8.7 

For the spring-mass-damper system given in Example 8.6, evaluate the transient 

response of the state variables to a unit step input using 

(a) The convolution integral 

(b) Inverse Laplace transforms 

Assume zero initial conditions. 
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«(f) 




(a) (b) 

Fig. 8.5 State variable time response and state trajectory for Example 8.4. 

Solution 

(a) From equation (8.51) 



x(0 = 0(0 



/' 

Jo 



hi(t-r) </>n(t-T) 
b 2 \(t-r) §ri(t-T) 



u(r)dr (8.66) 



dr 



Given that u(i) = 1 and \\m = 1, equation (8.66) reduces to 

b n {t-T)~ 

/o ihi(t-r)_ 

Inserting values from equation (8.62) 

q-V-t) _ Q -2(t-r) 



x(0 = f 

Jo 



x(0 



/ 

Jo 



Integrating 



x(0 



Q-(t-r) + 2Q- 2 ^- T "> 



Q -(t-r) _i Q -2(t-r) 
Q-tt-r) _|_ Q -2(t-r) 



dr 



JO 



Inserting integration limits (r = t and r = 0) 



*2 



1 _ p~* _|_ 1^-2* 

2 c ^2 C 

e -/ _ Q -2t 



(8.67) 



(8.68) 



(8.69) 



(b) An alternative method is to inverse transform from an ^-domain expression. 
Equation (8.45) may be written 



X(s) = ©(.s)x(O) + *(j)BU(j) 



(8.70) 
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*(t) 




(a) (b) 

Fig. 8.6 State variable step response and state trajectory for Example 8.5. 

Hence from equation (8.61) 



X(s) = *0) 
Simplifying 



1 



-2 



s + 1 s + 2 
1 1 



1 1 



j + 1 j + 2 
-1 2 



s+1 s + 2/ Vs+l ^ + 2 



1 1 



(8.71) 



X(*) = 



j(j+ 1) 2 ^(j + 2) 

-1 2 



Inverse transform 



which gives 



x(0 



x 2 



s(s+l) s(s + 2) 

(1 -e-')-^(l-e- 2r ) 
-(1 - e"0 + (1 - e" 2 ') 



1 _ a.-t j_ I A -2' 

2 C " l "2 C 

e"' - e" 2 ' 



(8.72) 



(8.73) 



(8.74) 



Equation (8.74) is the same as equation (8.69). 

The step response of the state variables, together with the state trajectory, is shown 
in Figure 8.6. 




8,3 Discrete-time solution of the state vector 
differential equation 

The discrete-time solution of the state equation may be considered to be the vector 
equivalent of the scalar difference equation method developed from a z-transform 
approach in Chapter 7. 
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The continuous-time solution of the state equation is given in equation (8.47). If 
the time interval (t — to) in this equation is T, the sampling time of a discrete-time 
system, then the discrete-time solution of the state equation can be written as 

r rT 



U eA ' Mr h 



x[(Jfc + \)T) = q ai x(kT) + <^ / e Ar Bdr \u(kT) (8.75) 



Equation (8.75) can be written in the general form 

x[(k + 1)7] = A(T)x(kT) + B(T)u(kT) (8.76) 

Note 

A(T)^A and B(T) ^ B 

Equation (8.76) is called the matrix vector difference equation and can be used for the 
recursive discrete-time simulation of multivariable systems. 

The discrete- time state transition matrix A(T) may be computed by substituting 
T = tin equations (8.49) and (8.50), i.e. 

A(T) = 0(70 = e Ar (8.77) 

or 

A 2 T 2 A k T k 

A(T) = 1 + AT + __+...+_ _ (8.78) 

2! k\ 

Usually sufficient accuracy is obtained with 5 < k < 50. 

The discrete- time control matrix B(T) from equations (8.75) and (8.76) is 

B(T)= / e Ar Bdr (8.79) 

Jo 

or 



Br 




f AT 2 \ 2 T 3 \ k T k + l> \ 

B OT = ,r + ^ + ^f + ... + ^ B ,8,0, 



Example 8.8 (See also Appendix 1, examp88.m) 

(a) Calculate the discrete-time transition and control matrices for the spring-mass- 
damper system in Example 8.6 using a sampling time T = 0.1 seconds. 

(b) Using the matrix vector difference equation method, determine the unit step 
response assuming zero initial conditions. 
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Solution 

(a) The exact value of A(T) is found by substituting T = t in equation (8.62) 



A(T) = <b(T) 



(2e- 01 - e" 02 ) (e" 01 - e" - 2 ) 


-2(e- 01 -e-°- 2 )(-e- 01 +2e- - 2 


" 0.991 0.086" 




.-0.172 0.733. 





(8.81) 



An approximate value of A(T) is found from equation (8.78), taking the series as far 

as k = 2. 



AT: 



0.1 
-0.2 -0.3 



A 2 r 2 

2! 



1 

-2 -3 



1 

-2 -3 



0.1 2 

1x2 



using the first 3 terms of equation (8.78) 



A(T) 



"1 0" 
.0 1. 


+ 


* 0.1 " 
.-0.2 -0.3. 


+ 


" 0.99 0.085" 




.-0.1'! 


1 


735 _ 







-0.01 -0.015 
0.03 0.035 



-0.01 -0.015 
0.03 0.035 



(8.82) 



Since in equation (8.66), u{r) is unity, the exact value of B(T) can be obtained by 
substituting T = tin equation (8.69) 



B(T) 



B(T) 



1 — P-O.l _i_Ip-0.2 

2 e i- 2 e 

e _ .l_ e _0.2 



0.00453 
0.0861 



(8.83) 



(8.84) 



An approximate value of B(7") is found from equation (8.80), taking the series as far 

as k = 2. 



B(D«(I7')B+ ("2J-IB 



A 2 r 3 

3! 



B 



" " 


+ 


" 0.005 " 


+ 


" -0.0005 " 


.0.1. 


.-0.015. 


.0.00117. 


" 0.0045 




.0.08 


617 









(8.85) 



(b) Using the values of A(T) and B(T) given in equations (8.81) and (8.84), together 
with the matrix vector difference equation (8.76), the first few recursive steps of 
the discrete solution to a step input to the system is given in equation (8.86) 
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kT ==0 







xi(0.1) 

x 2 (0.1) 


= 


0.991 
-0.172 


0.086 

0.733 _ 






+ 


0.00453 
0.0861 


1 == 


0.00453 
0.0861 






kT = 


= 0.1 








"xi(0.2)" 
x 2 (0.2) 


= 


" 0.991 
-0.172 


0.086" 

0.733 


"0.00453" 
0.0861 


+ 


"0.00453] 
0.0861 J 


" 0.016 
0.0148 


kT = 


= 0.2 








■jci(0.3)" 

x 2 (0.3) 


= 


" 0.991 
-0.172 


0.086" 

0.733 


"0.016" 
0.148 


+ 


"0.00453" 
0.0861 


1 == 


"0.033" 
0.192 




kT = 


= 0.3 








■*i(0.4)" 

x 2 (0.4) 


= 


" 0.991 
-0.172 


0.086" 

0.733 _ 


"0.033" 
0.192 


+ 


"0.00453" 
0.0861 


1 == 


"0.054" 

0.227 




kT = 


= 0.4 








"xi(0.5)" 
x 2 (0.5) 


= 


" 0.991 
-0.172 


0.086" 

0.733 


"0.054" 

0.227 


+ 


"0.00453" 
0.0861 


1 == 


"0.078" 
0.243 





(8.86) 



Example 8.9 

A system has a transfer function 



U 



(s) 



1 



' s 2 + 2s + 1 



The system has an initial condition y(0) == 1 and is subject to a unit ramp function 
u(t) == t. Determine 

(a) The state and output equations 

(b) The transition matrix <3>(V) 

(c) Expressions for the time response of the state variables. 



Solution 
(a) 



1 

1 -2 



x 2 



y = [l 0] 



X\ 

x 2 



(b) *(*): 



1 



(^+1)^+1) (^+1)(^+1) 

-1 s 



(c) 



Xi 

x 2 



(^+i)(^+i) (j + ixj + i). 

~ 3q- 1 + Its- 1 - 2 + f 
2tQ~ l + 1 - Q-* 
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8.4 Control of multivariable systems 
8.4.1 Controllability and observability 



The concepts of controllability and observability were introduced by Kalman (1960) 
and play an important role in the control of multivariable systems. 

A system is said to be controllable if a control vector u(7) exists that will transfer 
the system from any initial state x(7 ) to some final state x(t) in a finite time interval. 

A system is said to be observable if at time to, the system state x(7q) can be exactly 
determined from observation of the output y(t) over a finite time interval. 

If a system is described by equations (8.2) and (8.7) 



x = Ax + Bu 
y = Cx + Du 



(8.87) 



then a sufficient condition for complete state controllability is that the n x n matrix 



M = [B:AB:...:A" ! B] 



(8.88) 



contains n linearly independent row or column vectors, i.e. is of rank n (that is, the 
matrix is non-singular, i.e. the determinant is non-zero. See Appendix 2). Equation 
(8.88) is called the controllability matrix. 

The system described by equations (8.87) is completely observable if the n x n 
matrix 



N 



C T :A T C T : 



:(A T ) n - 1 C T ' 



(8.89) 



is of rank n, i.e. is non-singular having a non-zero determinant. Equation (8.89) is 
called the observability matrix. 



Example 8.10 (See also Appendix 1, examp810.m) 

Is the following system completely controllable and observable? 



x\ 

x 2 J 



-2 
3 -5 



X\ 

x 2 \ 



y = [l -1] 



X\ 

lx 2 



Solution 

From equation (8.88) the controllability matrix is 

M = [B:AB] 

where 



AB 



hence 



M = [B:AB] 



-2 

1 3 



"-2 " 
. 3 ~ 5 . 


"1" 




= 


' -2 
_ 3 _ 



(8.90) 
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Equation (8.90) is non-singular since it has a non-zero determinant. Also the two row 
and column vectors can be seen to be linearly independent, so it is of rank 2 and 
therefore the system is controllable. 

From equation (8.89) the observability matrix is 



N = [C T :A T C T ] 



where 



hence 



twt 



A X C 



~-2 3 " 
-5 


" 1 ' 
-1 


= 


~-5~ 
_ 5 _ 



N = [C T :A T C T ] = 



-1 5 



(8.91) 



Equation (8.91) is singular since it has a zero determinant. Also the column vectors 
are linearly dependent since the second column is -5 times the first column and 
therefore the system is unobservable. 



8.4.2 State variable feedback design 



Consider a system described by the state and output equations 

Ax + Bu 



x 



Cx 



(8.92) 



Select a control law of the form 



u = (r-Kx) (8.93) 

In equation (8.93), r(t) is a vector of desired state variables and K is referred to as the 
state feedback gain matrix. Equations (8.92) and (8.93) are represented in state 
variable block diagram form in Figure 8.7. 

Substituting equation (8.93) into equation (8.92) gives 



or 



x = Ax + B(r - Kx) 



x = (A - BK)x + Br 



(8.94) 



In equation (8.94) the matrix (A - BK) is the closed-loop system matrix. 

For the system described by equation (8.92), and using equation (8.52), the 
characteristic equation is given by 

|CsI-A)| =0 (8.95) 

The roots of equation (8.95) are the open-loop poles or eigenvalues. For the closed- 
loop system described by equation (8.94), the characteristic equation is 



|CsI-A + BK)| =0 
The roots of equation (8.96) are the closed-loop poles or eigenvalues. 



(8.96) 
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~®=> 




Fig. 8.7 Control using state variable feedback. 



Regulator design by pole placement 

The pole placement control problem is to determine a value of K that will produce 
a desired set of closed-loop poles. With a regulator, r(7) = and therefore equation 
(8.93) becomes 

u = -Kx 

Thus the control u(t) will drive the system from a set of initial conditions x(0) to a set 
of zero states at time t\, i.e. x(t\) = 0. 

There are several methods that can be used for pole placement. 

(a) Direct comparison method: If the desired locations of the closed-loop poles 
(eigenvalues) are 

s = fi u s = fi 2 , . .., s = fi n (8.97) 

then, from equation (8.96) 

(8.98) 
s n + a n -is n ~ l + • • • + a\s + a (8.99) 

Solving equation (8.99) will give the elements of the state feedback matrix. 

(b) Controllable canonical form method: The value of K can be calculated directly using 

k = [a - a :ai - a 2 : ... :a w _2 - a n - 2 '^n-i ~ tf w -i]T -1 (8.100) 

where T is a transformation matrix that transforms the system state equation into 
the controllable canonical form (see equation (8.33)). 



\sl - A + BK| =(S- fjbi)(s - fl 2 ) • • ■ (s ~ fin) 



T = MW 



(8.101) 
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where M is the controllability matrix, equation (8.88) 



W 



Q>2 



ttn-\ 
1 



a 2, 

1 





1 



(8.102) 



Note that T = I when the system state equation is already in the controllable 
canonical form. 

(c) Acker mann's formula: As with Method 2, Ackermann's formula (1972) is a direct 
evaluation method. It is only applicable to SISO systems and therefore u(t) and 
y(t) in equation (8.87) are scalar quantities. Let 



K= [0 ... 1]M"V(A) 
where M is the controllability matrix and 

0(A) = A n + a n -iA n ~ l + • • • + a x A + a l 



(8.103) 



(8.104) 



where A is the system matrix and a x are the coefficients of the desired closed-loop 
characteristic equation. 

Example 8.11 (See also Appendix 1, examp811.m) 
A control system has an open-loop transfer function 

U {S) s(s + 4) 

Whenxi =jandx 2 = x\, express the state equation in the controllable canonical form. 
Evaluate the coefficients of the state feedback gain matrix using: 

(a) The direct comparison method 

(b) The controllable canonical form method 

(c) Ackermann's formula 

such that the closed-loop poles have the values 

s = —2, s = — 2 

Solution 

From the open-loop transfer function 

y + Ay = u 

Let 



Then 



x\ =y 

X\ = X2 

X2 = —4X2 + U 



(8.105) 
(8.106) 

(8.107) 
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Equation (8.106) provides the output equation and (8.107) the state equation 



x 2 



1 
-4 



y = [l 0] 



X\ 

x 2 _ 
x 2 



The characteristic equation for the open-loop system is 



p 0" 

|_0 s_ 


- 


"0 1 1 
.0 -4 J 



\sl - Al 



Thus 

a\ = 4, cio = 

The required closed-loop characteristic equation is 

(s + 2)(s + 2) = 
or 

s 2 + As + 4 = 
i.e. 



: S 2 + 4^ + 



S + flitf + #o 



s + aqs + ao = 



hence 



ai = 4, a = 4 
(a) Direct comparison method: From equations (8.99) and (8.111) 

LsI-A + BKI = <? 2 + 4s + 4 



s 
s 



1 

-4 

s -1 

s + 4 



[fcifc: 



1*2. 



: ^ + 4s + 4 
: ^ + 4S + 4 
: ^ + As + 4 



From equation (8.1 14) 




k\ k 2 _ 
s -1 

k\ s + 4 + k 2 
s 1 + (4 + £ 2 > + fci = s 2 + 4s + 4 



ifci =4 



(8.108) 



(8.109) 



(8.110) 



(8.111) 



(8.112) 



(8.113) 



(4 + k 2 ) = 4 i.e. k 2 = 



(8.114) 



(8.115) 
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(b) Controllable canonical form method: From equation (8.100) 

K = [ao — ao : a\ — a\]T~ l 
= [4-0:4- 4JT- 1 
= [4 0]T- ! 



(8.116) 



now 



where 



T = MW 



M = [B:AB] 



AB 



"0 1 " 
-4 


"0" 
1 


= 


" 1 " 
-4 



giving 



M 



1 

1 -4 



(8.117) 



Note that the determinant of M is non-zero, hence the system is controllable. 
From equation (8.102) 



W 



a i 


1" 




"4 r 


1 







1 



Hence 



T = MW 



ro 


i " 


"4 r 




[1 0] 


i 


-4 


1 




1 



(8.118) 



Thus proving that equation (8.108) is already in the controllable canonical form. 
Since T _1 is also I, substitute (8.118) into (8.116) 



K = [4 0]I = [4 0] 
(c) Ackermann's formula: From (8.103) 

K = [0 1]M"V(A) 



From (8.117) 



From (8.104) 



M 



"-4 


-1" 




4 r 


-1 







1 



1 



0(A) = A -\-a\A-\-ao! 



(8.119) 



(8.120) 



(8.121) 
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inserting values 



1 

-4 
-4 
16 




-16 



1 
1 



4 



(8.122) 



Insert equations (8.121) and (8.122) into (8.120) 



K 



K = [4 0] 

These results agree with the root locus diagram in Figure 5.9, where K 
two real roots of s = -2, s = — 2 (i.e. critical damping). 



[0 1] 


"4 1" 
.1 o. 


"4 0" 
.0 4. 


[0 1] 


"16 4 

.4 





(8.123) 
4 produces 



8.4.3 State observers 



In section 8.4.2 where state feedback design was discussed, it was assumed that all the 
state variables were available for the control equation (8.93) for a regulator 



when r = 



u = (r - Kx) 



u = -Kx 



(8.124) 



Equations (8.124) requires that all state variables must be measured. In practice this 
may not happen for a number of reasons including cost, or that the state may not 
physically be measurable. Under these conditions it becomes necessary, if full state 
feedback is required, to observe, or estimate the state variables. 

A full-order state observer estimates all of the system state variables. If, however, 
some of the state variables are measured, it may only be necessary to estimate a few 
of them. This is referred to as a reduced-order state observer. All observers use some 
form of mathematical model to produce an estimate x of the actual state vector x. 
Figure 8.8 shows a simple arrangement of a full-order state observer. 

In Figure 8.8, since the observer dynamics will never exactly equal the system 
dynamics, this open-loop arrangement means that x and x will gradually diverge. If 
however, an output vector y is estimated and subtracted from the actual output 
vector y, the difference can be used, in a closed-loop sense, to modify the dynamics of 
the observer so that the output error (y - y) is minimized. This arrangement, some- 
times called a Luenberger observer (1964), is shown in Figure 8.9. 
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Observer 



Fig. 8.8 A simple full-order state observer. 

Let the system in Figure 8.9 be defined by 

x = Ax + Bu 
y = Cx 

Assume that the estimate x of the state vector is 

x = Ax + Bu + K e (y - Cx) 



(8.125) 
(8.126) 

(8.127) 



where K e is the observer gain matrix. 

If equation (8.127) is subtracted from (8.125), and (x - x) is the error vector e, then 

e = (A-K e C)e (8.128) 

and, from equation (8.127), the equation for the full-order state observer is 

x = (A - K e C)x + Bu + K e y (8.129) 

Thus from equation (8.128) the dynamic behaviour of the error vector depends upon 
the eigenvalues of (A - K e C). As with any measurement system, these eigenvalues 
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Observer 



A <C 



> x 



Fig. 8.9 The Luenberger full-order state observer. 

should allow the observer transient response to be more rapid than the system itself 
(typically a factor of 5), unless a filtering effect is required. 

The problem of observer design is essentially the same as the regulator pole 
placement problem, and similar techniques may be used. 

(a) Direct comparison method: If the desired locations of the closed-loop poles 
(eigenvalues) of the observer are 



fJLi,S = ti2,...,s 



Vn 



then 



\sl - A + K e C| =(S- /ii)(.S - fl 2 ) ■ ■ • (S - fJn) 

= s n + OL n -\s n ~ l H h ol\s + a 



(8.130) 
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(b) Observable canonical form method: For the generalized transfer function shown 
in Figure 8.4, the observable form of the state equation may be written 



X 2 





1 





-a 
-a x 



1 -a n -\ 

"X\ 





~X\" 




r h i 




x 2 


+ 


bx 




-X n _ 




bn-\. 



y = [0 ... 1] 



x 2 



(8.131) 



Note that the system matrix of the observable canonical form is the transpose of the 
controllable canonical form given in equation (8.33). 

The value of the observer gain matrix K e can be calculated directly using 



K e = Q 



a - a 
a\ — a\ 

ot n -\ — a n _\ 



(8.132) 



Q is a transformation matrix that transforms the system state equation into the 
observable canonical form 

Q = (WN T ) _1 (8.133) 

where W is defined in equation (8.102) and N is the observability matrix given in 
equation (8.89). If the equation is in the observable canonical form then Q = I. 

(c) Acker mann's formula: As with regulator design, this is only applicable to systems 
where u(t) and y(t) are scalar quantities. It may be used to calculate the observer 
gain matrix as follows 

K e = ^)(A)N- 1 [0 ... if 

or alternatively 

r C u 

CA 

K e = 0(A) . . (8.134) 

_CA"- 
where 0(A) is defined in equation (8.104). 

Example 8.12 (See also Appendix 1, examp812.m) 
A system is described by 



~X\~ 

J 


v = [ 


' 

-2 

1 0] 


1 " 

-3_ 

'X\~ 

.*2_ 


~X\~ 

.*2_ 


+ 


"0" 

_1_ 
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Design a full-order observer that has an undamped natural frequency of 10 rad/s and 
a damping ratio of 0.5. 

Solution 

From equation (8.89), the observability matrix is 



N: 



C T : A T C 



1 
1 



(8.135) 



N is of rank 2 and therefore non-singular, hence the system is completely observable 
and the calculation of an appropriate observer gain matrix K e realizable. 
Open-loop eigenvalues: 



\sl - Al 



3s + 2 = s + a\s + ao 



Hence 

CIq = 2, CL\ = 3 

And the open-loop eigenvalues are 

s 2 + 3s + 2 = 
0+l)(.s + 2) = 

s = —1, s = — 2 

Desired closed-loop eigenvalues: 

s 2 + 2(ou n s + 1^ = 
s 2 + 10s + 100 = s 2 + oqs + a = 
Hence 

a = 100, ai = 10 

and the desired closed-loop eigenvalues are the roots of equation (8.138) 
lii = -5 + J8.66, fjb 2 = -5 - J8.66 

(a) Direct comparison method: From equation (8.130) 

|sl - A + K e C| = s 2 + a\ + a 



s 
s 



1 

-2 -3 j 
s -1 

2 s + 3 



k Q 2 



[1 0] 



_k e2 

S + £ e l "I 

2 + k Q2 s + 3 



10s +100 



10s +100 



s 2 + 10s+100 



(8.136) 



(8.137) 



(8.138) 



(8.139) 



s 2 + (3 + £ e i)s + (3*ei + 2 + /c e2 ) = s 2 + 10s + 100 



(8.140) 
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From equation (8.140) 



(3+&ei)=10, fcel = 7 

(3^ e i +2 + /c e2 ) = 100 
k Q2 = 100 - 2 - 21 = 77 

(b) Observable canonical form method: From equation (8.132) 

K e =Q 





<*o - 


on 


Q 








_a\ - 


a\ 




[100 


-2] 


Q 








10- 


-3 



From equation (8.133) 
and from equation (8.102) 



Q = (WN X ) 



T\-l 



w 



a\ 


r 




3 r 


1 







1 



1 
1 



N 1 



1 
1 



"3 l" 


"1 0" 




"3 1" 


1 


1 




1 



Since from equation (8.135) 

N = 
Thus 

WN T 
and 



^ -1 

Since Q^I then A is not in the observable canonical form. 
From equation (8.143) 



K e 



(c) Ackermann's Formula: From (8.134) 



" 


-1" 




[° 


1 


-1 


3 




1 


-3_ 



"0 1 

1 -3 


"98" 

7 


= 


" 7 ' 
77 



K e = <MA) 



c 

CA 



(8.141) 



(8.142) 



(8.143) 



(8.144) 



(8.145) 



(8.146) 



(8.147) 



(8.148) 
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Using the definition of </>(A) in equation (8.104) 



K e 



K e 



(A + a\A + ckq!) 



-2 -3 
6 7 

98 7 

14 77 

98 7 

14 77 



1 
1 


1 





20 
0" 
1_ 

7 
77 



10 
-30 



1 
1 



-i-l r 



100 
100 



1 
1 



(8.149) 



(8.150) 



8.4.4 Effect of a full-order state observer on a closed-loop 
system 

Figure 8.10 shows a closed-loop system that includes a full-order state observer. In 
Figure 8.10 the system equations are 

x = Ax + Bu 

y = Cx (8.151) 

The control is implemented using observed state variables 

u = -Kx (8.152) 

If the difference between the actual and observed state variables is 

e(0 = x(0 - x(t) 
then 

x(0 = x(0-e(0 (8.153) 

Combining equations (8.151), (8.152) and (8.153) gives the closed-loop equations 

x = Ax - BK(x - e) 
= (A-BK)x + BKe (8.154) 

The observer error equation from equation (8.128) is 

e = (A-K e C)e (8.155) 

Combining equations (8.154) and (8.155) gives 



A - BK BK 
A - B P C 



(8.156) 



Equation (8.156) describes the closed-loop dynamics of the observed state feedback 
control system and the characteristic equation is therefore 



LsIA + BK|LsI-A + K e C| =0 



(8.157) 
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System 

y 




Fig. 8.10 Closed-loop control system with full-order observer state feedback. 

Equation (8.157) shows that the desired closed-loop poles for the control system are 
not changed by the introduction of the state observer. Since the observer is normally 
designed to have a more rapid response than the control system with full order 
observed state feedback, the pole-placement roots will dominate. 

Using the state vectors x(t) and x(t) the state equations for the closed-loop system 
are 

From equations (8.151) and (8.152) 



x = Ax - BKx 



(8.158) 



and from equation (8.129) 



x = (A - K e C)x - BKx + K e Cx 
= (A - K e C - BK)x + K e Cx 



(8.159) 



Thus the closed-loop state equations are 



A -BK 

K e C A - K e C - BK 



(8.160) 
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8.4.5 Reduced-order state observers 



A full-order state observer estimates all state variables, irrespective of whether they 
are being measured. In practice, it would appear logical to use a combination of 
measured states from y = Cx and observed states (for those state variables that are 
either not being measured, or not being measured with sufficient accuracy). 

If the state vector is of nth order and the measured output vector is of mth order, 
then it is only necessary to design an (n — m)th order state observer. 

Consider the case of the measurement of a single state variable x\(t). The output 
equation is therefore 



x\ 



Cx = [l ... 0]x 



Partition the state vector 



(8.161) 



(8.162) 



where x e are the state variables to be observed. 
Partition the state equations 



xi 



A e l 



X\ 

x 2 



01 

B e 



(8.163) 



If the desired eigenvalues for the reduced-order observer are 

S = /ile, S = /i 2e > • • • > S = /i(«-l) e 

Then it can be shown that the characteristic equation for the reduced-order observer is 



\sl - A ee + K e Ai e | =(S~ /ile) • • • (S ~ /i(«-l)e) 



s n x + «( w -2)e^ 2 H h oi\ Q s + a 



(8.164) 



In equation (8.164) A ee replaces A and Ai e replaces C in the full-order observer. 

The reduced-order observer gain matrix K e can also be obtained using appropriate 
substitutions into equations mentioned earlier. For example, equation (8.132) 
becomes 



Ke = Q e 



ol\q - a\ Q 



(X(n-2)e — a(n-2)e 



(8.165) 



where a oe , . . . , <3( w -2)e are the coefficients of the open-loop reduced order character- 
istics equation 



\sl - A e , 



S n X + a(n-2)eS n 2 + Cl\ Q S + <2 e 



(8.166) 



and 



Qe = (W e N e 1 ) 



-T\-l 



(8.167) 
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where 



W e 



Cl2 



a n -2 
1 



a 2 



®3 

1 




a n -i 1 
,. 1 



and 



N e 



A T • A TA T • 



(A ee T)"- 2 AT 



and Ackermann's formula becomes 



K e = 0(A ee ) 



A, A n ~ 3 

Ay A n ~ 2 



where 



Define 



Then 



0(A ee ) 



vn-\ 



OLn-lK 



Xel 



n-2 



a 2 A ee + ail 



K e j 



(8.168) 



(8.169) 



(8.170) 



(8.171) 



(8.172) 
(8.173) 



x = x e i - K e y 
The equation for the reduced-order observer can be shown to be 

x e i = (A ee KeAie)xei + {A e iK e fln + (A ee - K e Ai e )K e }y + (B e - K Q bi)u 
Figure 8.11 shows the implementation of a reduced-order state observer. 

Case study 



Example 8.13 (See also Appendix 1, examp813.m) 

(a) In case study Example 5.10 a control system has an open-loop transfer function 



G(s)H(s) 



1 



s(s + 2)(s + 5) 
The controller was a PD compensator of the form 

G(s) = K 1 (s + a) 
With K\ = 15 and a = 1, the system closed-loop poles were 

s = -3.132 ±j3.253 
s = -0.736 
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r = 



System 



x = Ax + Bu 
y=Cx 



y=xi 



f — ► 



Be-Ke^ 



O 

I 



*x 




o 

Xe1 



/ 




A e i — K e an 



+1 M 




"ee "*e"1e 



Reduced-Order 
Observer 



s 



K e y 



1 

K e 



Fig. 8.1 1 Implementation of a reduced-order state observer. 

with the resulting characteristic equation 

s 3 + 7s 2 + 25^+15 = 

Demonstrate that the same result can be achieved using state feedback methods. 

(b) Design a reduced second-order state observer for the system such that the poles 
are a factor of 10 higher than the closed-loop system poles, i.e. 

s= -31.32 ±j32.53 

which correspond to cu n = 45.16 rad/s and ( = 0.7. 

Solution 

(a) G(s)H(s) 



1 



s 3 + 7s 2 + 10s + 
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From equations (8.33) and (8.34) 






1 











1 





-10 


-7 



B 



C = [l 0] 



(8.174) 



Open-loop characteristic equation 

s 3 + 7s 2 + 10^ + = 



s 3 + ci2S 2 + a\s + ao = 
Closed-loop characteristic equation 

s 3 + 7s 2 + 25s +15 = 
s + a 2 s + a\s + ao = 
Using direct comparison method 



(8.175) 



(8.176) 



si - A + BKI = s 5 + 7s 2 -f 25s + 15 



s 0" 




s 


- 


0^ 





1 
1 
-10 -7 
s -1 
j -1 
10 s + 7 



[&i k 2 k 3 ] 






_k\ k 2 k 3 
-1 

s -1 

k\ 10 + fo s + 7 + £ 3 



= s 3 +7s 2 + 25s+15 



s 3 + Is 2 -f 25s +15 



- 7s 2 + 25s +15 



Expanding the determinant in equation (8.177) gives 

ki = 15, ^ = 15, ^3=0 
Hence 



(8.177) 



-[15 15 0] 



x 2 
x 3 



(8.178) 



since x 2 = x\, this is identical to the original PD controller 

G(s)= 15(s+l) 

Although the solution is the same, the important difference is with state feedback, the 
closed-loop poles are placed at directly the required locations. With root locus, a 
certain amount of trial and error in placing open-loop zeros was required to achieve 
the desired closed-loop locations. 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC08.3D - 266 - [232-271/40] 9.8.2001 2:34PM 



266 Advanced Control Engineering 

(b) Reduced-order state observer. Partitioning the system equation A in (8.174) and 
inserting in equation (8.164) 



s 
s 



1 
-10 -7 j 
s -1 

10 s + 7 



k Q 2 



[1 0] 



_k e2 o 
s + k G \ - 1 
10 + £ e2 s + 7 
■ (7 + fc e i> + (7A: e i + 10 + £ e2 ) 



r + 2^^ + ^n 

s 2 + 63.2s + 2039.4 

s 2 + a\ Q s + a 0e 
s 2 + 63.2^ + 2039.4 



Equating coefficients in equation (8.179) 

(7 + £ e i) = 63.2 £ e i=56.2 

(7x 56.2 + 10 + £ e2 ) = 2039.4 
£ e2 = 1636 
Referring to Figure 8.11 and partitioned systems (8.174) and (8.163) 



B e — K Q b\ = 


"0" 

_i. 


- 


" 56.2 " 
.1636. 





= 


"0" 

.1. 










A e i — K Q an = 


"0" 
.0. 


- 


"56.2" 
.1636. 


= 


"0" 
.0. 










^ee -k-e-^-le == 


" ( 


) 

10 


1 

-7. 






"56 

.16: 


2" 
56. 


[1 


0] = 


"-56.2 
.-1646 


1 " 

-7. 



(8.179) 



(8.180) 



(8.181) 



(8.182) 



Inserting equation (8.182) into Figure 8.11 gives the complete state feedback and 
reduced observer system shown in Figure 8.12. 

Comparing the system shown in Figure 8.12 with the original PD controller given 
in Example 5.10, the state feedback system may be considered to be a PD controller 
where the proportional term uses measured output variables and the derivative term 
uses observed state variables. 



8.5 Further problems 

Example 8.14 

For the d.c. motor shown in Figure 4.14, the potential difference across the armature 

winding is given by equation (4.21) 

e a (0 - e b (0 = £ a -jy + R*k(t) 
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System 



x 2 


= 


1 
1 
0-10-7 


_X3_ 







1 



y=[1 0]x 



y=xi 




Fig. 8.12 Complete state feedback and reduced observer system for case study Example 8.11. 
where, from equation (4.20) 



e h (t) = K b 



d9 

di 



and the torque T m (t) developed by the motor is given by equation (4.18) 

T m (t) = KJ a (t) 

If the load consists of a rotor of moment of inertia / and a damping device of 
damping coefficient C, then the load dynamics are 

„, /N ^d<9 d 2 
where is the angular displacement of the rotor. 
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(a) Determine the state and output equations when the state and control variables 
are 



X\ 



X 2 — X\ ? X3 — ^a ? ^ — ^sl 



(b) Determine the state and output equations when the state and control variables 
are 



x\ 



X 2 = X\, X3 = X 2 , u = e a 



Solution 
(a) 

""xi" 

x 2 
x 3 



1 

• 7 K f 



- 



^ b ^ 

















"xi" 

x 2 


+ 


" " 

1 


-a 




_ X 3_ 




_u_ 


a . 











9 = [I 0]x 



(b) 



X2 
X 3 



- 
0=[] 0]x 



1 

1 

{K & K h + R a C) _(R* C 





r 1 




Xi 









x 2 


+ 


K, 




Xi 








ILJi 



Example 8.15 

Find the state and output equations for the positional servomechanism shown in 

Figure 8.13 when the state and control variable are 



Solution 



x\ = c(t), X2 = xi, u = r(t) 



Xi 

*2 




K 


1 
C 




Xi 

_*2_ 


+ 


"0" 


m 


m J 






Lm J 



c = [l 0]x 



^^ 



?) > 


K 




1 




Q 




► 


A77S 2 + CS 




» ► 











Fig. 8.13 Block diagram of positional servomechanism. 
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C(s) 



Fig. 8.14 Closed-loop control system. 



Example 8.16 

Find the state and output equations for the closed-loop control system shown in 

Figure 8.14 when the state and control variables are 

X\ = c(t), X2 = X\, X3 = X2, u = r(t) 



Solution 



X\ 







1 







X\ 







x 2 


= 








1 




x 2 


+ 





x 3 




-640 


-192 


18 




x 3 




1 



c = [640 160 0]x 

Example 8.17 

Figure 8.15 shows the block diagram representation of a car cruise control system 

where U(s) is the desired speed, X(s) is the accelerator position and V(s) is the actual 

speed. 

(a) Find the state and output equations when the state and control variables are 

x\ = x(t), X2 = v(t), u = u(t) 

(b) Determine the continuous-time state transition matrix 0(0- 

(c) For a sampling time of 0.1 seconds, evaluate from 0(0 the discrete-time state 
transition matrix A(T). 



Accelerator Servo 




X(s) 



Vehicle Dynamics 




Fig. 8.15 Car cruise control system. 
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(d) Using the first three terms of equation (8.80), compute the discrete-time control 
transition matrix B(T). Using the difference equations 

x(k + \)T = A(T)x(kT) + Bu(kT) 

determine values for the state variables when u(kT) is a piece-wise constant 
function of the form 



^r(sec) 0.1 0.2 0.3 0.4 
u(kT) 10 15 20 25 30 



Assume zero initial conditions. 



Solution 



(a) 







X2J 3—3 

v = [0 l]x 



(b) 0(0 = 

(c) A(r) : 

(d) B(T) 



3(-e 



it 



- e~ M ) 



0.819 
0.234 0.741 

0.181" 
0.025 



kT(sQc) 0.1 0.2 0.3 0.4 

u(kT) 10 15 20 25 30 

xx 1.81 4.197 7.057 10.305 

x 2 0.25 0.984 2.211 3.915 

Example 8.18 

The ship roll stabilization system given in case-study Example 5.11 has a forward- 
path transfer function 

K 



S d 



(s) 



C?+1)C? 2 + 0.7^ + 2) 



(a) For the condition K = 1 , find the state and output equations when 
*i = </>a(0> X2 = x\ 9 X3 = X2 and u = 6^(t). 

(b) Calculate the controllability matrix M and the observability matrix N and 
demonstrate that the system is fully controllable and fully observable. 

(c) Determine the state feedback gain matrix K that produces a set of desired closed- 
loop poles 

s = -3.234 ±j3.3 

j = -3.2 
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(d) Find the observer gain matrix K e for a full-order state observer that produces a 
set of desired closed-loop poles 

s= —16.15 ± J16.5 

s= -16 

(e) If output a (0 = x\ is measured, design a reduced-order state observer with 
desired closed-loop poles 

s= —16.15 ± J16.5 

Solution 



(a) 



x\ 
x 2 
x 3 



[1 






-2 - 

0]x 



1 



2.7 








~X\~ 




"0" 


1 




x 2 


+ 





1.7 




_ X 3. 




1 



(b) M = 






1 1 


1 


-1.7 


1.7 


0.19 



det(M) = -l,rank(M) = 3 
System fully controllable. 



N: 



ri 





01 





i 











1 



det(N) = 1, rank(N) = 3 
System fully observable. 

(c) K = [66.29 39.34 7.968] 

(d) K e = [8527.2 1047.2 46.6] 

(e) K e = [530.3 30.6] 
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9 



Optimal and robust control 
system design 



9.1 Review of optimal control 

An optimal control system seeks to maximize the return from a system for the 
minimum cost. In general terms, the optimal control problem is to find a control u 
which causes the system 

x = g(x(t),u(t),t) (9.1) 

to follow an optimal trajectory x(t) that minimizes the performance criterion, or cost 
function 

J= [ A(x(0, u(0, t)dt (9.2) 

The problem is one of constrained functional minimization, and has several 
approaches. 

Variational calculus, Dreyfus (1962), may be employed to obtain a set of differ- 
ential equations with certain boundary condition properties, known as the Euler- 
Lagrange equations. The maximum principle of Pontryagin (1962) can also be 
applied to provide the same boundary conditions by using a Hamiltonian function. 

An alternative procedure is the dynamic programming method of Bellman (1957) 
which is based on the principle of optimality and the imbedding approach. The 
principle of optimality yields the Hamilton-Jacobi partial differential equation, 
whose solution results in an optimal control policy. Euler-Lagrange and Pontrya- 
gin's equations are applicable to systems with non-linear, time-varying state equa- 
tions and non-quadratic, time varying performance criteria. The Hamilton-Jacobi 
equation is usually solved for the important and special case of the linear time- 
invariant plant with quadratic performance criterion (called the performance index), 
which takes the form of the matrix Riccati (1724) equation. This produces an optimal 
control law as a linear function of the state vector components which is always stable, 
providing the system is controllable. 

9.1.1 Types of optimal control problems 



(a) The terminal control problem: This is used to bring the system as close as possible 
to a given terminal state within a given period of time. An example is an 
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automatic aircraft landing system, whereby the optimum control policy will focus 
on minimizing errors in the state vector at the point of landing. 

(b) The minimum- time control problem: This is used to reach the terminal state in the 
shortest possible time period. This usually results in a 'bang-bang' control policy 
whereby the control is set to u max initially, switching to u m i n at some specific time. 
In the case of a car journey, this is the equivalent of the driver keeping his foot 
flat down on the accelerator for the entire journey, except at the terminal point, 
when he brakes as hard as possible. 

(c) The minimum energy control problem: This is used to transfer the system from an 
initial state to a final state with minimum expenditure of control energy. Used in 
satellite control. 

(d) The regulator control problem: With the system initially displaced from equilib- 
rium, will return the system to the equilibrium state in such a manner so as to 
minimize a given performance index. 

(e) The tracking control problem: This is used to cause the state of a system to track 
as close as possible some desired state time history in such a manner so as to 
minimize a given performance index. This is the generalization of the regulator 
control problem. 



9.1.2 Selection of performance index 



The decision on the type of performance index to be selected depends upon the 
nature of the control problem. Consider the design of an autopilot for a racing yacth. 

Conventionally, the autopilot is designed for course-keeping, that is to minimise 
the error ^e(0 between that desired course ^d(0 and the actual course ip a (t) in the 
presence of disturbances (wind, waves and current). Since ipd(t) is fixed for most of 
the time, this is in essence a regulator problem. 

Using classical design techniques, the autopilot will be tuned to return the vessel on 
the desired course within the minimum transient period. With an optimal control 
strategy, a wider view is taken. The objective is to win the race, which means 
completing it in the shortest possible time. This in turn requires: 

(a) Minimizing the distance off-track, or cross-track error y Q (t). Wandering off track 
will increase distance travelled and hence time taken. 

(b) Minimizing course or heading error ip e (t). It is possible of course to have zero 
heading error but still be off-track. 

(c) Minimizing rudder activity, i.e. actual rudder angle (as distinct from desired 
rudder angle) 8 a (t), and hence minimizing the expenditure of control energy. 

(d) Minimizing forward speed loss u Q (t). As the vessel yaws as a result of correcting 
a track or heading error, there is an increased angle of attack of the total velocity 
vector, which results in increased drag and therefore increased forward speed 
loss. 

From equation (9.2) a general performance index could be written 

h(y Q (t\ MtX u e (t\ 6 a (t))dt (9.3) 



/" 
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Quadratic performance indices 

If, in the racing yacht example, the following state and control variables are defined 

*i = y t (t\ X 2 = V>e(0> X 3 = u e (t\ u = 6 a (t) 
then the performance index could be expressed 



J= / {(SllX\ +#22*2 + 433*3) + (riu)}dt 



or 



/: 



T(Qx 

J to 



Ru)dr 



(9.4) 



(9.5) 



If the state and control variables in equations (9.4) and (9.5) are squared, then the 
performance index become quadratic. The advantage of a quadratic performance 
index is that for a linear system it has a mathematical solution that yields a linear 
control law of the form 



u(0 = -Kx(0 
A quadratic performance index for this example is therefore 



J= { (411*1 + 422*2 + 433*3) + ( r lU 2 ) }dt 



(9.6) 



(9.7) 



/ 



or, in general 



/' 



[*1 *2 *3] 



J = 



411 





" 




~*l" 





422 







*2 








433 _ 




_ X 3_ 



'[«][/•! ][«] 



At 



(x T Qx + u T Ru)d? 



(9.8) 



Q and R are the state and control weighting matrices and are always square and 
symmetric. J is always a scalar quantity. 



9.2 The Linear Quadratic Regulator 

The Linear Quadratic Regulator (LQR) provides an optimal control law for a linear 
system with a quadratic performance index. 



9.2.1 Continuous form 



Define a functional equation of the form 



/(x, t) = min 



iin / h(x,u)dt 

U Jto 



(9.9) 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACEC09.3D - 275 - [272-324/53] 9.8.2001 2:39PM 



Optimal and robust control system design 275 

where over the time interval ^o to t\ , 

f(x,t ) =/(x(0)) 
/(x, /i) = 

From equations (9.1) and (9.2), a Hamilton-Jacobi equation may be expressed as 

df 



dt 



-mm 



/z(x,u)+ (^Q g(x,u) 



For a linear, time invariant plant, equation (9.1) becomes 

x = Ax + Bu 
And if equation (9.2) is a quadratic performance index 



J= (x T Qx + u T Ru)d^ 



Substituting equations (9.11) and (9.12) into (9.10) 



dt 



-mm 



x T Qx + u T Ru + (-jPj (Ax + Bu) 



Introducing a relationship of the form 

/(x,0 = x T Px 
where P is a square, symmetric matrix, then 



oj_ = T d_ 

dt dt 



1 " Px 



and 



dx 

d l 

dx 



2Px 



2x T P 



Inserting equations (9.15) and (9.16) into (9.13) gives 

9P 
x T —x = -min [x T Qx + u T Ru + 2x T P(Ax + Bu)] 



dt 



To minimize u, from equation (9.17) 



owidt] 

du 



2u T R + 2x T PB = 



Equation (9.18) can be re-arranged to give the optimal control law 

R-'B^Px 



(9.10) 



(9.11) 



(9.12) 



(9.13) 



(9.14) 



(9.15) 



"opt 



(9.16) 



(9.17) 



(9.18) 



(9.19) 
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or 



where 



L*opt 



-Kx (9.20) 



K = R ! B T P (9.21) 

Substituting equation (9.19) back into (9.17) gives 

x T Px = -x T (Q + 2PA - PBR ! B T P)x (9.22) 

since 

2x T PAx = x T (A T P + PA)x 

then 

P = -PA - A T P - Q + PBR ! B T P (9.23) 

Equation (9.23) belongs to a class of non-linear differential equations known as the 
matrix Riccati equations. The coefficients of P(t) are found by integration in reverse 
time starting with the boundary condition 

x T (t l )nhMt l ) = (9.24) 

Kalman demonstrated that as integration in reverse time proceeds, the solutions of 
P(t) converge to constant values. Should t\ be infinite, or far removed from to, the 
matrix Riccati equations reduce to a set of simultaneous equations 

PA + A T P + Q - PBR ! B T P = (9.25) 

Equations (9.23) and (9.25) are the continuous solution of the matrix Riccati 
equation. 

9.2.2 Discrete form 

From equation (8.76) the discrete solution of the state equation is 

x[(k + \)T] = A(T)x(kT) + B(T)u(kT) (9.26) 

For simplicity, if (kT) is written as (k), then 

x(k + 1) = A(T)x(k) + B(T)u(k) (9.27) 

The discrete quadratic performance index is 

N-l 

J = J2 (* T (k)Qx(k) + u T (£)Ru(£))r (9.28) 

£=0 

The discrete solution of the matrix Riccati equation solves recursively for K and P in 
reverse time, commencing at the terminal time, where 

K(N - (k + 1)) = [TR + B T (r)P(7V - k)B(T)]- l B T (T)P(N - k)A(T) (9.29) 
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and 

P(7V - (k + 1)) = [TQ + K T (7V - (k + l))rRK(7V - (A: + 1))] + [A(T) 

- B(T)K(N - (k + 1))] T P(7V - /c)[A(r) - B(r)K(7V - (fc + 1))] 

(9.30) 

As k is increased from to TV — 1, the algorithm proceeds in reverse time. When run 
in forward-time, the optimal control at step k is 

u opt (£) = -K(k)x(k) (9.31) 

The boundary condition is specified at the terminal time (k = 0), where 

x T (7V)P(7V)x(7V) = (9.32) 

The reverse-time recursive process can commence with P(N) = or alternatively, 
with P(7V - 1) = TQ. 

Example 9.1 (See also Appendix 1, examp91.m) 

The regulator shown in Figure 9.1 contains a plant that is described by 



~X\~ 


= 


' 1 " 

.-1 -2. 




~Xi' 

_*2. 


+ 


"0" 

_1_ 



y = [\ 0]x 



and has a performance index 

/ = 

Determine 

(a) the Riccati matrix P 

(b) the state feedback matrix K 

(c) the closed-loop eigenvalues 



2 
1 



dt 



r = 




=> 



x = Ax + Bu 





Fig. 9.1 Optimal regulator. 
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Solution 
(a) 





-1 


1 

-2 


B = 



1 






2 0" 
1 




R = scalar = 


: 1 



From equation (9.25) the reduced Riccati equation is 

PA + A T P + Q - PBR ! B T P = 



PA 



Pxx Pn 
Pix P22 



1 

-1 -2 



-Pn Pn-2pi2 

_ —Pn Pix — 2pn 



(9.33) 
(9.34) 



A X P 



-1 

1 -2 

PBR ! B T P = 



PXX PX2 

P2X P22 . 

PXX PX2 

P2X P22 

Pn 



—P2X —P22 

_PXX ~ 2-P2X PX2 ~ 2-P22 



1[0 1] 



PXX PX2 
P2X P22 



P22 



[P2X P22 ] 



PX2P2X PX2P22 
_P22P2X P 2 22 

Combining equations (9.34), (9.35) and (9.36) gives 



~PX2 PXX ■ 


-2/712 


+ 


—P2X —P22 




—P22 P2X - 


- 2^22 _ 




PU — 2/721 PX2 - 2/722 _ 






+ 


"2 0" 




PxiPix PX2P22 








1 




P22P2X P 2 1: 





(9.35) 



(9.36) 



(9.37) 



Since P is symmetric, /?2i = Pn- Equation (9.37) can be expressed as four simultan- 
eous equations 



-Pn -p\2 + 2-p\ 2 = 

PU ~ 2p i2 -P22 -P\2P22 = 



(9.38) 
(9.39) 
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-P22 +P\\- 2pn -PnPii = (9.40) 



Pn ~ 2P22 + Pn ~ 2P22 + 1 -p\ 2 = 
Note that equations (9.39) and (9.40) are the same. From equation (9.38) 



solving 



Using positive value 



From equation (9.41) 



solving 



Using positive value 



From equation (9.39) 



Pn + 2 Pn " 2 = 



/?i2 =7^21 = 0.732 and —2.732 



Pn =P2i =0.732 



2pi2~ 4^22 + 1 -^22 =° 

p 2 22 + 4p 22 - 2.464 = 



p 22 = 0.542 and -4.542 



p 22 = 0.542 



p u - (2 x 0.732)-0.542 - (0.732 x 0.542) = 
pn = 2.403 

From equations (9.42), (9.43) and (9.44) the Riccati matrix is 



2.403 0.732 
0.732 0.542 



(b) Equation (9.21) gives the state feedback matrix 

K = R ! B T P=1[0 1] 
Hence 



2.403 0.732 
0.732 0.542 



(9.41) 



(9.42) 



(9.43) 



(9.44) 



(9.45) 



(9.46) 



K = [0.732 0.542] 
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(c) From equation (8.96), the closed-loop eigenvalues are 

|^I-A + BK| =0 

[0.732 0.542] =0 



0.732 0.542 

s -1 

1.732 s + 2.542 

s 2 + 2.542s +1.732 = 

s u s 2 = -1.271 ±j0.341 

In general, for a second-order system, when Q is a diagonal matrix and R is a scalar 
quantity, the elements of the Riccati matrix P are 



\s 0] 




r o 1 1 




r o "1 


1° s . 




-1 -2 


+ 


i 




Is -1 1 










1 s + 2_ 


+ 



ii = 


r 


P12P22 ~ P22&2X — P\2tt22 


12=7,21 = k 


_l / 2 , ^11*2 


r 

21 = bi 


a 22 ± 


/ 2 , ( 2 Pn + ^22) 

y^2+ r 



(9.47) 



9.3 The linear quadratic tracking problem 

The tracking or servomechanism problem is defined in section 9. 1 .1(e), and is directed 
at applying a control u(i) to drive a plant so that the state vector x(t) follows a desired 
state trajectory r(t) in some optimal manner. 



9.3.1 Continuous form 



The quadratic performance index to be minimized is 

J= [(r-x) T Q(r-x) + u T Ru]d; 



(9.48) 



It can be shown that the constrained functional minimization of equation (9.48) 
yields again the matrix Riccati equations (9.23) and (9.25) obtained for the LQR, 
combined with the additional set of reverse-time state tracking equations 



s = (A - BR ! B T P) T s - Qr 



(9.49) 
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Plant 



s = (A-BR" 1 B T P) T s-Qr 



Reverse-Time Equations 

Tracking vector 



> -R 1 B T 




7 - 



Command 
vector 



7\ 



x=Ax+Bu 



P- c 



Fig. 9.2 Optimal tracking system. 

where s is a tracking vector, whose boundary condition is 

s(*i) = 
and the optimal control law is given by 

Uo 

If 

v = -R-^s 

and 



(9.50) 



u opt 



-R _1 B T Px - R _1 B T s 



K = R ^P 



Then 



u opt 



= v-Kx 



(9.51) 



Hence, if the desired state vector r(t) is known in advance, tracking errors may be 
reduced by allowing the system to follow a command vector \(t) computed in 
advance using the reverse-time equation (9.49). An optimal controller for a tracking 
system is shown in Figure 9.2. 



9.3.2 Discrete form 



The discrete quadratic performance index, writing (kT) as (k), is 



N-\ 



J = J2 K r ( fc ) " x (^)) T Q( r (£) - X W) + u T (£)Ru(£)]r 



(9.52) 



£=0 



Discrete minimization gives the recursive Riccati equations (9.29) and (9.30). These 
are run in reverse-time together with the discrete reverse-time state tracking equation 



s(N -Qc+ 1)) = F(7>(7V -k) + G(T)r(N - k) 



(9.53) 
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having the boundary condition 



s(N) = 



F(r) and G(T) are the discrete transition and control matrices and are obtained by 
converting the matrices in the continuous equation (9.49) into discrete form using 
equations (8.78) and (8.80). 

The command vector v is given by 

\(N -k) = -R ! B T s(7V - k) (9.54) 

When run in forward-time, the optimal control at time (kT) is 

u op t(£70 = v(kT) - K(kT)x(kT) (9.55) 

The values of x(kT) are calculated using the plant state transition equation 

x(k + \)T = A(T)x(kT) + B(T)u opt (kT) (9.56) 



Example 9.2 (See also Appendix 1, examp92.m) 

The optimal tracking system shown in Figure 9.2 contains a plant that is described by 



~X\~ 

M. 


! = 


' 
.-1 
"1 0" 
.0 1. 


1 


1. 

' X 

X 


l 

2 


~X\~ 

.*2_ 


+ 


"0" 

_1_ 



The discrete performance index is 

200 



'=£ 



^=o 



(n(kT) - x x {kT)){r 2 {kT) - X2 (kT)) 



10 
1 



r x {kT) - x x {kT) 
r 2 (kT) - x 2 (kT) 



u(kT) 2 



It is required that the system tracks the following desired state vector 



rxikT) 
r 2 (kT) 



1.0sin(0.6284^r) 
0.6cos(0.6284£r) 



over a period of 0-20 seconds. The sampling time T is 0.1 seconds. 

In reverse-time, starting with P(iV) = at NT = 20 seconds, compute the state 
feedback gain matrix K(kT) and Riccati matrix P(kT) using equations (9.29) and 
(9.30). Also in reverse time, use the desired state vector r(kT) to drive the tracking 
equation (9.53) with the boundary condition s(N) = and hence compute the com- 
mand vector \(kT). 

In forward-time, use the command vector \{kT) and state vector x(kT) to calculate 
u opt (kT) in equation (9.55) and hence, using the plant state transition equation (9.56) 
calculate the state trajectories. 
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Solution 

The reverse-time calculations are shown in Figure 9.3. Using equations (9.29) and 
(9.30) and commencing with P(iV) = 0, it can be seen that the solution for K (and also 
P) settle down after about 2 seconds to give steady-state values of 



K(kT) 

P(kT) 



[2.0658 1.4880] 
8.0518 2.3145 
2.3145 1.6310 



(9.57) 



Using equation (9.49), together with equations (8.78) and (8.80), to calculate F(T) 
and G(T) in equation (9.53), for T = 0A seconds, the discrete reverse-time state 
tracking equation is 



and 



si(N-(k+l)) 




0.9859 -0.2700 


si(N-k) 




s 2 (N-(k+l))_ 




0.0881 0.7668 _ 


_s 2 (N-k)_ 




+ 


" -0.9952 0.0141 
_ -0.0460 -0.0881 _ 


'n(N- 

j 2 (N- 


-k) 
-k)_ 


v(N- 


-k) 


= 


-1[0 1] 


s 2 (N- 


-k) 







(9.58) 



Then the command vector v (in this case a scalar) is generated in reverse-time as 
shown in Figure 9.3. The forward-time response is shown in Figure 9.4. 




10 12 

Time (s) 



Fig. 9.3 Reverse-time solutions for a tracking system. 
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Fig. 9.4 Forward-time response of a tracking system. 

The optimal control is calculated using equation (9.55) and the values of the state 
variables are found using the plant state transition equation (9.56) 



*i(fc+i)r 




0.9952 0.0950 


xi(kT) 


+ 


0.0048 


x 2 (k+l)T 




-0.0950 0.9002 


x 2 {kT) 


0.0950 



u opt (kT) (9.59) 



where A(T) and B(T) are calculated from equations (8.78) and (8.80). From Figure 
9.4 it can be seen that after an initial transient period, the optimal control law takes 
the form of a phase lead compensator. Because of the weighting of the Q matrix in 
the performance index, x\(kT) tracks r\(kT) more closely than x 2 (kT) tracks r 2 (kT). 



9.4 The Kalman filter 

In the design of state observers in section 8.4.3, it was assumed that the measure- 
ments y = Cx were noise free. In practice, this is not usually the case and therefore 
the observed state vector x may also be contaminated with noise. 



9.4.1 The state estimation process 



State estimation is the process of extracting a best estimate of a variable from a 
number of measurements that contain noise. 

The classical problem of obtaining a best estimate of a signal by combining two 
noisy continuous measurements of the same signal was first solved by Weiner (1949). 
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His solution required that both the signal and noise be modelled as random process 
with known statistical properties. 

This work was extended by Kalman and Bucy (1961) who designed a state 
estimation process based upon an optimal minimum variance filter, generally 
referred to as a Kalman filter. 



9.4.2 The Kalman filter single variable estimation problem 



The Kalman filter is a complementary form of the Weiner filter. Let A x be a 
measurement of a parameter x and let its variance P a be given by 

P a = E{(A x -A x ) 2 } (9.60) 

where A x is the mean and E{ } is the expected value. 

Let B x be a measurement from another system of the same parameter and the 
variance P^ is 

P b = E{(B x -B x ) 2 } (9.61) 

Assume that x can be expressed by the parametric relationship 

x = A x K + B x (l-K) (9.62) 

where K is any weighting factor between and 1 . The problem is to derive a value of 
K which gives an optimal combination of A x and B x and hence the best estimate of 
measured variable x, which is given the symbol x (pronounced x hat). 
Let P be the variance of the weighted mean 

P = E{(x-x) 2 } (9.63) 

The optimal value of K is the one that yields the minimum variance, i.e. 

S = ° (9 - 64) 



Substitution of equation (9.62) into (9.63) gives 
Hence K is given by 



P = K 2 P A + (1 - K) 2 P B (9.65) 






{K 2 P A + (l-K) 2 P B }=0 



From which 



Pa+Pb 
Substitution of equation (9.66) into (9.62) provides 



K = - Pb n (9.66) 



{T7ty} (A '- B '> (967) 
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Measurement 
System A 



Measurement 
System B 



x+P A 



x+P b 






Pa-Pb 



Fig. 9.5 Integration of two measurement systems to obtain optimal estimate. 



or 

x = A x - K(A X - B x ) 

K is the Kalman gain and the total error variance expected is 

P = Pa~ K(P a - P B ) 
so that 

x = x + P A - K(P A - P B ) 
Equation (9.70) is illustrated in Figure 9.5. 



(9.68) 

(9.69) 
(9.70) 



9.4.3 The Kalman filter multivariable state estimation problem 

Consider a plant that is subject to a Gaussian sequence of disturbances w(kT) with 
disturbance transition matrix C^(T). Measurements z(k + \)T contain a Gaussian 
noise sequence \(k + X)T as shown in Figure 9.6. 

The general form of the Kalman filter usually contains a discrete model of the 
system together with a set of recursive equations that continuously update the 
Kalman gain matrix K and the system co variance matrix P. 

The state estimate x(k+\/k+ 1) is obtained by calculating the predicted state 
x(k + l/k) from 

x(k + l/k)T = A(T)x(k/k)T + B(T)u(kT) (9.71) 

and then determining the estimated state at time (k + l)T using 

x(k + l/k + \)T = x(k + l/k)T + K(k + \){z(k + 1)7 - C(T)x(k + l/£)r} (9.72) 

The term (^/^) means data at time £ based on information available at time k. The 
term (k + l/£) means data used at time k+\ based on information available at time 
k. Similarly (k + 1/A: + 1) means data at time £ + 1 based on information available at 
time k+\. 

The vector of measurements is given by 



z(k + l)r = C(T)x(k + l)r + v(fe + 1)T 



(9.73) 
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Fig. 9.6 Plant with disturbance and measurement noise. 

where 

z(£ + 1)T is the measurement vector 

C(T) is the measurement matrix 

\(k + 1)7" is a Gaussian noise sequence 

The Kalman gain matrix K is obtained from a set of recursive equations that 
commence from some initial covariance matrix P(k/k) 

P(k + l/k) = A(T)P(k/k)A T (T) + C d (T)QC T d (T) (9.74) 

K(k + 1) = P(k + i/^)c T (r){C(r)P(^ + i/^)c T (r) + r} _1 (9.75) 

P(k + 1/A: + 1) = {I - K(k + l)C(T)}P(ik + 1/ik) (9.76) 

The recursive process continues by substituting the covariance matrix P(k + l/k + 1) 
computed in equation (9.76) back into (9.74) as P(k/k) until K(A: + 1) settles to a 
steady value, see Appendix 1, script files kalfilc.m for the continuous solution and 
kalfild.m for the above discrete solution. In equations (9.74)-(9.76) 

Cd(T') is the disturbance transition matrix 
Q is the disturbance noise covariance matrix 
R is the measurement noise covariance matrix 

Equations (9.71)— (9.76) are illustrated in Figure 9.7 which shows the block diagram 
of the Kalman filter. 

The recursive equations (9.74)-(9.76) that calculate the Kalman gain matrix and 
covariance matrix for a Kalman filter are similar to equations (9.29) and (9.30) that 
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Fig. 9.7 The Kalman filter. 

calculate the feedback matrix and Riccati matrix for a linear quadratic regulator. The 
difference is that the Kalman filter is computed in forward-time, the LQR being 
computed in reverse-time. 



9.5 Linear Quadratic Gaussian control system design 

A control system that contains a LQ Regulator/Tracking controller together with a 
Kalman filter state estimator as shown in Figure 9.8 is called a Linear Quadratic 
Gaussian (LQG) control system. 



v(kT) 



=> 



x(kT) 



=> 



LQ Optimal 
Controller 



Uopt(kT) 



V. 



=> 



Kalman Filter 
State Estimator 



<= 



Plant 



z(kT) 



Fig. 9.8 Linear Quadratic Gaussian (LQG) control system. 
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Case study 



Example 9.3 (See also Appendix 1, examp93.m) 

China clay is used in the paper, ceramics and fertilizer industries, and is washed from 
quarry faces, by high pressure hoses. A pressing operation reduces the moisture 
content in the clay to about 30%, and then the clay is extruded into small cylindrical 
shaped noodles. The clay noodles are then passed through the band drying oven 
shown in Figure 9.9 at rates varying between 2 and 15 tonnes/hour. Upon exit, the 
moisture content of the clay should be controlled to a desired level of between 4 and 
12%, with a deviation of no more than ±1 %. The process air is heated by mixing the 
exhaust gas from a gas burner with a large quantity of dilution air to meet the 
specified air flow-rate into the dryer. 

An existing control arrangement uses a PID controller to control the temperature 
of the process air (measured by thermocouples) and the dry clay moisture content 
measured by samples taken by the works laboratory. If this is out of specification, 
then the process air temperature is raised or lowered. The dry clay moisture content 
can be measured by an infrared absorption analyser, but on its own, this is consid- 
ered to be too noisy and unreliable. 

The important process parameters are 

(a) Burner exhaust temperature t\>(f) (°Q 

(b) Dryer outlet temperature t&(f) (°C) 

(c) Dryer outlet clay moisture content rn$ (t) (%) 

The important control parameters are 

(i) Burner gas supply valve angle v a (0 (rad) 
(ii) Dryer clay feed-rate f{(t) (tonnes/hour) 



Process Air 



Wet 
Clay In 



Top Band 



Middle Band 



Lower Band 



Dry Clay 
, Out 



1 V 

Exhaust Air 



Fig. 9.9 Band drying oven. 
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A proposed control scheme by Drew and Burns (1992) uses an LQG design, whereby 
the three process parameters are controlled in an optimal manner, their values 
(particularly the moisture control) being estimated. 

System model. The dynamic characteristics of the dryer were measured experimen- 
tally. This yielded the following transfer functions 



Burner model 



Dryer model 



Moisture models 



Gi(s) = ^(s) 



420 
l+47s 



r(\ Td ^ °- 119 
G2( * ) = 7^ ) = TT200^ 



G 3 i(s) = —(s) 



G 3 2(s) = A ^(s) = - 



-0.167 
1 + 440s 

0.582 



440s 



Equations (9.79) and (9.80) can be combined to give 

„.. -0.167^(^ + 0.582^^) 
M((S) = ~ 1+440, 

The block diagram of the system is shown in Figure 9.10. 

Continuous state-space model: From equations (9.77)— (9.81) 

47/ b + t h (t) = 420v a (0 
200i d + td(t) = 0. 119 t d (t) 
440m f + m ( (t) = -0.167 t d (t) + 0.582/1(0 



(9.77) 

(9.78) 

(9.79) 
(9.80) 

(9.81) 



(9.82) 
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Fig. 9.10 Model of band dryer system. 
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Define the state variables 

x\ = t b , x 2 = t d , x 3 = Wf 
and the control variables 

U\ = v a 
and the disturbance variables 

W\ =0, W 2 = 0, W3 =f{ 

then equations (9.82) can now be written as 

x\ = -0.02128xi + 8.93617wi + c dn w x 



x 2 = 0.00060xi - 0.00500x2 + c d22 w 2 

x 3 = -0.00038x2 - 0.00227x3 + 0.001 32w 3 



(9.83) 



where c d \\ and Cd22 are unknown burner and dryer disturbance coefficients, and are 
given an arbitrary value of 0.1. The state equations are written in the form 

x = Ax + Bu + CdW 



xi 
x 2 
x 3 



- 


0.0213 









0.0006 -0.005 


-0.00038 -0.0023 




"0.1 




W\ 






0.1 




w 2 






_ 0.00132 




W3 







~X\~ 




"8.9362" 




X 2 


+ 







_ X 3_ 








U] 



and the output equation is 



"^b" 




"1 0" 




"xi" 


^d 


= 


1 




x 2 


YH{ 




1 




_ X 3_ 



(9.84) 



Discrete system model: The discrete system model (without disturbances) is given by 



x(k + 1)7 = A(T)x(kT) + B(T)u(kT) 
For a sampling time of 2 seconds, from equations (8.78) and (8.80) 

A(T): 

LQR Design: Using the quadratic performance index 

poo 

J= (x T Qx + u T Ru)d^ 

Jo 



0.9583 










17.4974 


0.0012 


0.9900 





; B(T) = 


0.0105 





-0.0008 


0.9955 








(9.85) 



(9.86) 
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where Q and R are diagonal matrices of the form 



qn 











<?22 











<?33 



R 









r 22 



(9.87) 



From equations (9.20) and (9.21), the optimal control law is 



a opt 



where 



K = R BP 



Kx 



ItjT! 



(9.88) 



The design procedure employed was to maintain R as unity scalar, and systematically 
vary the diagonal elements of Q to achieve the performance specification. This was to 
maintain a dry clay moisture content of 6%, ±1 %, as the clay feed-rate varied from 6 
to 10 tonnes/hour. Also the drying oven temperature t& should not vary more than 
dz3°C from the set point of 50 °C. At each design setting, the clay feed-rate was 
varied according to 



w 3 (0 = 8 + 2sin(0.001540 



(9.89) 



Some results are presented in Table 9.1. 

It was found that q\\ had little effect, and was set to zero. From Table 9.1, the 
settings that meet the performance specification are 




0.5 
20 



(9.90) 



From equation (9.25), the Riccati matrix is 



0.1 
-0.2 



0.1 


-0.2 1 


10.8 


-30 


-30 


3670.4 



(9.91) 



which gives, from equation (9.88), the feedback gain matrix 

K = [0.0072 0.6442 -1.8265] (9.92) 

The same results are also obtained from the discrete equations (9.29) and (9.30). 



Table 9.1 Variations in dryer temperature and moisture content 

#22 #33 Variation in temperature td (°C) Variation in moisture content (%) 







Max 


Min 


Max 


Min 


3 


1 


0.17 





2.09 


-2.11 


1 


3 


0.99 





1.74 


-2.13 


0.5 


3 


1.524 





1.5 


-2.15 


0.5 


6 


2.05 


-2.05 


1.27 


-1.27 


0.5 


10 


2.42 


-2.42 


1.1 


-1.1 


0.5 


20 


2.86 


-2.86 


0.89 


-0.89 
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The closed-loop eigenvalues are 



-0.0449 ±j0.0422 
-0.0033 



(9.93) 



Implementation: The optimal control law was implemented by using 

ui = Ke 



where 



(r-x) 



(9.94) 



This is shown in Figure 9.11. 

A discrete simulation was undertaken using equations (9.85) and (9.86) together 
with a disturbance transition matrix C^(T), which was calculated using Cd in equa- 
tion (9.84) and equation (8.80) for B(T), with a sampling time of 2 seconds. 



c d (r) 



The desired state vector was 



0.1958 

0.0001 0.199 

-0.0001 0.0026 



(9.95) 



r = 



450 
50 
-6 



(9.96) 



Note that the moisture content rj, is negative because of the moisture model in 
equation (9.79). The initial conditions were 



x(0) 



200 

30 

-30 



(9.97) 



Optimal Controller 



+ /<~>e 



> K 



=> 



V 
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Dryer 
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=> 



Fig. 9.11 Optimal control of band dryer. 
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and the disturbance vector 






W3 



(9.98) 



where w 3 , the clay feed-rate was set at a value between 6 and 10 tonnes/hour. Figure 
9.12 shows the time response of u\(t), the gas-valve angle in radians. The valve angle 
was not allowed to have a negative value, so remained closed for the first 80 seconds 
of the simulation, when the dryer was cooling. The steady-state angle was 0.95 
radians, or 54°. 

Figure 9.13 indicates the burner temperature time response t^(t). The temperature 
falls from its initial value, since the gas valve is closed, and then climbs with a 
response indicated by the eigenvalues in equation (9.93) to a steady-state value of 
400 °C, or a steady-state error of 50 °C. 

Figure 9.14 shows the combined response of the dryer temperature t&(i) and the 
moisture content mf(t), the latter being shown as a positive number. The dryer 
temperature climbs to 48 °C (steady-state error of 2°C) and the moisture falls to 
6%, with no steady-state error. In this simulation the clay feed-rate w^t) was 
constant at 8 tonnes/hour. 

As the band dryer is a type zero system, and there are no integrators in the 
controller, steady-state errors must be expected. However, the selection of the 
elements in the Q matrix, equation (9.90), focuses the control effort on control- 
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Fig. 9.12 Time response of gas-valve angle u-\(t). 
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Fig. 9.13 Time response of burner temperature fbW- 

ling the moisture content, at the expense of, in particular, the burner temperature 
t h (t). 

Figure 9.15 shows the final 500 seconds of the moisture content simulation as the 
clay feed-rate is varied between 6 and 10 tonnes/hour. After 1 000 seconds, as the clay 
leaves the dryer, the moisture content is between 5.2% and 6.8%, which is within the 
specification of ±1 % of the set point of 6%. 

Kalman filter design: If the three stages of the co variance matrix P are written as 
P(k/k) = Pi; P(k +l/k) = P 2 and P(k + l/k + 1) = P 3 , then recursive equations 
(9.74), (9.75) and (9.76) become 



P 2 = AP 1 A 1 +C d QC^ 
K = P 2 C T {CP 2 C T + R} _1 
P 3 = {I - KC}P 2 



(9.99) 



Equation set (9.99) is simpler to visualize, but remember the system matrices are the 
transition matrices A(T), B(T) and C<i(T). Before recursion can start, values for R, 
the measurement noise co variance matrix, and Q, the disturbance noise co variance 
matrix must be selected. 

Measurement noise covariance matrix R: The main problem with the instrumentation 
system was the randomness of the infrared absorption moisture content analyser. 
A number of measurements were taken from the analyser and compared with samples 
taken simultaneously by work laboratory staff. The errors could be approximated to 
a normal distribution with a standard deviation of 2.73%, or a variance of 7.46. 
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Fig. 9.14 Combined response of dryer temperature t$(t) and moisture content nrif(t). 
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Fig. 9.15 Effect of varying clay feed-rate. 
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The thermocouples measuring the burner and dryer temperatures were relatively 
noise-free, with standard deviations in the order of 0.1 °C. The variance was therefore 
set at 0.01, giving 



R 



0.01 











0.01 











7.46 



(9.100) 



Disturbance noise covariance matrix Q: This was set as a diagonal matrix, where q\\ 
and #22 represent changes in the burner and dryer temperatures as a result of 
changing heat transfer through the walls of the dryer, due to wind and variations 
in external temperature. 

On the other hand, #33 is a measure of clay feed-rate variations, and a standard 
deviation of 0.3 tonnes/hour seemed appropriate. In the absence of any other infor- 
mation, standard deviations of the burner and dryer temperatures was also thought to 
be in the order of 0.3 °C. Thus, when these values are squared, the Q matrix becomes 



Q = 



0.1 











0.1 











0.1 



(9.101) 



Before equations (9.99) can be run, and initial value of P(k/k) is required. Ideally, 
they should not be close to the final value, so that convergence can be seen to have 
taken place. In this instance, P(k/k) was set to an identity matrix. Figure 9.16 shows 
the diagonal elements of the Kalman gain matrix during the first 20 steps of the 
recursive equation (9.99). 
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Fig. 9.16 Convergence of diagonal elements of Kalman gain matrix. 
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Fig. 9.17 Measured and filtered clay moisture content. 
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The final values of the Kalman Gain matrix K and covariance matrix P were 



K 



0.4408 


0.0003 







0.0044 








0.0003 


0.4579 





; p = 





0.0046 








-0.0006 


0.0325 










0.2426 



(9.102) 



The full LQG system, comprising of the LQ optimal controller and Kalman filter was 
then constructed. Figure 9.17 shows a set of moisture content measurements z^{kT) 
together with the estimated moisture content xi(kT). 



9.6 Robust control 



9.6.1 Introduction 



The robust control problem is to find a control law which maintains system response 
and error signals within prescribed tolerances despite the effects of uncertainty on the 
system. Forms of uncertainty include 

• Disturbance effects on the plant 

• Measurement noise 

• Modelling errors due to nonlinearities 

• Modelling errors due to time-varying parameters 

In previous chapters, linear models have been used to describe plant dynamics. 
However, in section 2.7.1 it was demonstrated that nonlinear functions could be 
linearized for small perturbations about an operating point. It is therefore possible to 
describe a nonlinear system by a series of linear models each constructed about 
a known operating point. If the operating point can be linked to a measurement, then 
a simple robust system may be constructed using an LQG approach. The feedback 
and Kalman gain matrices are calculated in advance for each operating point and 
some form of interpolation used to provide a 'Gain Scheduling Controller.' 

The disturbance and measurement noise is taken into account by the Kalman 
filter. In the following example, undertaken by the author (1984), a non-linear 
simulation of a ship of length 161m and displacement 17 000 tonnes was given 
a series of step changes in demanded rudder-angle at forward speeds of 2.572 m/s 
(5 knots), 5.145 m/s (10 knots) and 7.717 m/s (15 knots). At each forward speed a linear 
model was constructed and the Q and R matrices in an LQG implementation selected 
to return the closed-loop eigenvalues back to some desired value (Ackermann's 
formula could not be used since y(t) and u(t) were vector, not scalar quantities). 

A subset of the state error variables is 



e\(f) = cross-track position error 
ei(t) = cross-track velocity error 
e 3 (t) = heading error 
e\{t) = heading-rate error 
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The feedback control is of the form 



^opt 



Ke 



where the values of K for the three forward speeds are 

K2.572 = [0.0121 1.035 7.596 160.26] 
K5.145 = [0.0029 0.3292 1.81 25.963] 
K 7 .7i 7 = [0.0013 0.1532 0.8419 8.047] 



(9.103) 



If the forward velocity of the ship is the state variable u s , a best estimate of which is 
given by the Kalman filter, the gain scheduling controller can be expressed as 



k x = 0.08^T 20 
k 2 = 6.0w s ~ L8 
k 3 = 50.0u; 20 
k 4 = 2090.0w7 2 - 72 



(9.104) 



Equation set (9.104) approximates to an inverse square law, and increases the 
controller gains at low speeds, where the control surfaces are at their most insensitive. 
In general, however, robust control system design uses an idealized, or nominal 
model of the plant G m (s). Uncertainty in the nominal model is taken into account by 
considering a family of models that include all possible variations. The control 
system is said to have robust stability if a controller can be found that will stabilize 
all plants within the family. However, on its own, robust stability is not enough, since 
there may be certain plants within the family that are on the verge of instability. 
A controller is said to have robust performance if all the plants within the family meet 
a given performance specification. 

9.6.2 Classical feedback control 



Figure 9.18 shows a classical feedback control system D(s) is a disturbance input, 
N(s) is measurement noise, and therefore 

Y(s) = G(s)U(s) + D(s) 

B(s)= Y(s) + N(s) (9.105) 

U(s) = C(s)(R(s) - B(s)) 



R(s) 



Controller/Compensator 
U(s) 




Fig. 9.18 Classical feedback control system. 
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Eliminating U(s) and B(s) from equations (9.105) gives 

Y( , = G(s)C( S )R( S ) Djs) G(s)C(s)N(s) 

K> 1 + G(s)C(s) 1 + G(s)C(s) 1 + G(s)C(s) K ' ' 

Define a sensitivity function S(s) that relates Y(s) and D(s) when R(s) = N(s) = 

L (s) = S(s) = —J—— (9.107) 

D 1 + G(s)C(s) 

and define a complementary sensitivity function 

T(s)=l-S(s) = -^^- (9.108) 

1 + G(s)C(s) 

Thus, when N(s) = 0, equation (9.106) may be written 

Y(s) = T(s)R(s) + S(s)D(s) (9.109) 

If T(s) = 1 and S(s) = there is perfect set-point tracking and disturbance rejection. 
This requires that G(s)C(s) is strictly proper (has more poles than zeros), so that 

lim G(s)C(s) = (9.110) 

s—>oo 

However, if N(s) ^ 0, then equation (9.106) becomes 

Y(s) = T(s)R(s) + S(s)D(s) - T(s)N(s) (9.111) 

Hence, if T(s) = 1, there will be both perfect set-point tracking and noise acceptance. 
Considering the problem in the frequency domain however, it may be possible that at 
low frequencies T(]uj) — > 1 (good set-point tracking) and at high frequencies 
T(juj) — > (good noise rejection). 



9.6.3 Internal Model Control (IMC) 

Consider the system shown in Figure 9.19 G(s) is the plant, G m (s) is the nominal 
model, R(s) is the desired value, U(s) is the control, D(s) is a disturbance input, Y(s) is 
the output and N(s) is the measurement noise. C(s) is called the IMC controller and is 
to be designed so that y(t) is kept as close as possible to r(t) at all times. 
From Figure 9.19, the feedback signal i?(s) is 

B(s) + G(s)U(s) + D(s) + N(s) - G m (s)U(s) 

or 

B(s) = (G(s) - G m (s))U(s) + D(s) + N(s) (9.1 12) 

If, in equation (9.112) the model is exact, i.e. G m (s) = G(s) and the disturbance D(s) 
and noise N(s) are both zero, then B(s) is also zero and the control system is 
effectively open-loop. This is the condition when there is no uncertainty. However, 
if G m (s) ^ G(s), and D(s) and N(s) are not zero, then B(s) expresses the uncertainty of 
the process. 
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Fig. 9.19 Block diagram of an IMC system. 



9.6.4 IMC performance 



From Figure 9.19 

Y(s) = G(s)U(s) + D(s) 

B(s) = Y(s) + N(s) - G m (s) U(s) (9.113) 

U(s) = C(s)(R(s) - B(s)) 
Eliminating U(s) and B(s) from equations (9.113) gives 

G(s)C(s)R(s) (1 - C(s)G m (s))D(s) G(s)C(s)N(s) 



Y(s) 



1 + C(s)(G(s) - G m (s)) 1 + C(s)(G(s) - G m (s)) 1 + C(s)(G(s) - G m (s)) 

(9.114) 



The sensitivity function S(s) that relates Y(s) and D(s) when R(s) = N(s) = is 

(9.115) 



L( \ = S( ) = 1 - C(s)G m (s) 
D {S> {S) 1 + C(s)(G(s) - G m (s)) 



and the complementary sensitivity function 



T(s) = 1 - S(s) = 



C(s)G(s) 



1 + C(s)(G(s) - G m (s)) 
Thus, when N(s) = 0, equation (9.1 14) may be written 

Y(s) = T(s)R(s) + S(s)D(s) 



(9.116) 



(9.117) 



If T(s) = 1 there is perfect set-point tracking. This will occur if G m (s) = G(s) and 
C(s) = l/G(s). If S(s) = there is perfect disturbance rejection. Again, this will occur 
if G m (s) = G(s) and C(s) = 1/G m (s). 

Two degree-of -freedom IMC system 

If good set-point tracking and good disturbance rejection is required when the 
dynamic characteristics of R(s) and D(s) are substantially different, then it may be 
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Fig. 9.20 Two degree-of-freedom IMC system. 

necessary to introduce a second controller, which provides a second degree-of-free- 
dom of control action. A two degree-of-freedom IMC system is shown in Figure 9.20. 
With a two degree-of-freedom IMC system, equation (9.114) becomes 



Y(s) 



G(s)Q(s)R(s) 



1 + C d (s)(G(s) - G m (s)) 
G(s)C d (s)N(s) 
1 + C d (s)(G(s) - G m (s)) 



(1 - C d (s)G m (s))D(s) 
1 + C d (s)(G(s) - G m (sj) 



(9.118) 



In equation (9.1 18) C r (s) is designed for set-point tracking and C d (s) for disturbance 
rejection. 



9.6.5 Structured and unstructured model uncertainty 

Unstructured model uncertainty relates to unmodelled effects such as plant distur- 
bances and are related to the nominal plant G m (s) as either additive uncertainty £ a (s) 



G(s) = G m (s) + Us) 
or multiplicative uncertainty £ m (s) 

G(s) = (l+£ m (s))G m (s) 
Equating (9.119) and (9.120) gives 

Us) = Us)G m (s) 



(9.119) 



(9.120) 



(9.121) 



Block diagram representations of additive and multiplicative model uncertainly are 
shown in Figure 9.21. 

Structured uncertainty relates to parametric variations in the plant dynamics, i.e. 
uncertain variations in coefficients in plant differential equations. 
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Us) 



G m {s) 



T + 



5S8H. 



Us) 



►(^ ► On(s) 



(a) Additive Mode Uncertainty (b) Multiplicative Uncertainty 

Fig. 9.21 Additive and multiplicative model uncertainty. 

9.6.6 Normalized system inputs 



All inputs to the control loop (changes in set-point or disturbances) are generically 
represented by V(s). The input V(s) is found by passing a mathematically bounded 
normalized input V l (s) through a transfer function block W(s), called the input 
weight, as shown in Figure 9.22. 



Specific inputs 



Impulse V\s) = \ W(s) = 1 
Step V\s) = \ W(s)=l/s 



(9.122) 



Thus for specific inputs 



V(s)= W(s)V\s)= W(s) 
Sets of bounded inputs may be represented by 



no 



JO 



(t)fdt < 1 



(9.123) 



(9.124) 



The left-hand side of equation (9.124) is called 'the 2-norm of the input signal v l (t) 
squared'. Norms are mathematical measures that enable objects belonging to the 




Fig. 9.22 Transformation of a normalized bounded input \/ 1 (s) into an actual input V(s). 
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same set to be compared. Using Parseval's theorem, equation (9.124) may be trans- 
formed into the frequency domain 



I 1/ xH 2 1 

V (0 



2tt 



f 

J — c 



VQlj) 2 



W{]u) 



&u<\ (9.125) 



For a realizable controller to exist, all external signals that enter the control loop 
must be bounded. 



9.7 H 2 - and Hoc-optimal control 
9.7.1 Linear quadratic H 2 -optimal control 

The scalar version of equation (9.48), when u(i) is not constrained, and Q is unity, is 
called the Integral Squared Error (ISE), i.e. 



„2/ 



ISE= / e z (t)dt (9.126) 

Jt 



The 7/ 2 -optimal control problem is to find a contoller c(t) such that the 2-norm of the 
ISE (written HKOII2) * s minimized for just one specific input v(f). 

If, in equation set (9.105) B(s) and Y(s) are eliminated and U(s) is written as 
C(s)E(s), then 

= S(s){R(s) - D(s) - N(s)} (9.127) 

Also, from equation (9.123), for a specific input 

V(s)= W{s) (9.128) 

Using Parseval's theorem, from equation (9.126) the 7/2-optimal control problem can 
be expressed in the frequency domain as 

1 A»00 

mm\\e(i)\\ 2 2 =mm— / |£(j^)| 2 d^ (9.129) 

Substituting equations (9.127) and (9.128) into (9.129) gives 

1 C°° 

min|K0ll2= ™n^ / |^(j^)^(j^)| 2 du; (9.130) 

c " c 2ttJ_ 00 

Thus the 7/2-optimal controller minimizes the average magnitude of the sensitivity 
function weighted by W{ jcj), where W(]ul)) depends upon the specific input V(]uj). In 
mathematical terms, the controller minimizes the 2-norm of the sensitivity function 
weighted by W{]uj). 
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9.7.2 Hoo-optimal control 



With 7/oo-optimal control the inputs V{]uS) are assumed to belong to a set of norm- 
bounded functions with weight W(juj) as given by equation (9.125). Each input 
V(jco) in the set will result in a corresponding error E(]uj). The 7/oo-optimal controller 
is designed to minimise the worst error that can arise from any input in the set, and 
can be expressed as 

min|K0lloc= min suv\S(]u))W(]u>)\ (9.131) 

c " c u 

In equation (9.131), sup is short for supremum, which means the final result is the 
least upper bound. Thus the 7/oo-optimal controller minimizes the maximum magni- 
tude of the weighted sensitivity function over frequency range co, or in mathematical 
terms, minimizes the oo-norm of the sensitivity function weighted by W(}u;). 



9.8 Robust stability and robust performance 
9.8.1 Robust stability 



Robust stability can be investigated in the frequency domain, using the Nyquist 
stability criterion, defined in section 6.4.2. 

Consider a Nyquist contour for the nominal open-loop system G m (jcj)C(jcc;) with 
the model uncertainty given by equation (9.119). Let Z a (cj) be the bound of additive 
uncertainty and therefore be the radius of a disk superimposed upon the nominal 
Nyquist contour. This means that G(jlo) lies within a family of plants 7r(G(jcc;) e n) 
described by the disk, defined mathematically as 

7T = {G: \GijLj) - G m (jw)| < Ulj)} (9.132) 

and therefore 

|4(j")|<4(") (9.133) 

If the multiplicative uncertainty in equations (9.120) and (9.121) is defined as 

4( \(J) 
G m (]uj)C(]uj) 

and the bound of multiplicative uncertainty 

\G m (]uj)C(]uj)\ 
From equation (9.135) the disk radius (bound of uncertainty) is 

Uu) = |G m (j^)C(j^)|4(^) (9.136) 

From the Nyquist stability criterion, let N(k, G( jo;)) be the net number of clockwise 
encirclements of a point (k, 0) of the Nyquist contour. Assume that all plants in the 
family n, expressed in equation (9.132) have the same number (n) of right-hand plane 
(RHP) poles. 
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H+G m (MC(j< 



\1+G(\u)CQuj)\ 
for some G(\(j)e7r 



s \G m Qu))CQfj)\£ m (u) 
Fig. 9.23 Robust stability. 

There will be robust stability of a specific controller C(]uj) if and only if 

JV(-1, G()oj)C()oj)) = -n for all G(]uj) e tt (9.137) 

It is also necessary for the nominal plant G m (juJ) to be stable 

JV(-1, G m (]uo)C(]u)) = -n (9.138) 

From Figure 9.23 robust stability occurs when the vector magnitude 
|1 + G m (jcc;)C(jcc;)| (see also Figure 6.25) exceeds the disk radius \G m (]uJ)C(]uJ)\l m (uJ) 

|1 + G m (]uo)C()uj)\ > |G m (jw)C(jcj)|4(w) for all u 



or 



G m (]uj)C()uo) 



1 + G m (j^)C(jc^) 



a(^) < 1 



(9.139) 



Equation (9.139) uses the magnitude of the complementary sensitivity function T(juj) 
as defined in equation (9.108). Thus 



|r(]V)|4i(^) < 1 for all uj 



(9.140) 



Robust stability can therefore be stated as: Tf all plants G(s) in the family tt have the 
same number of RHP poles and that a particular controller C(s) stabilizes the 
nominal plant G m (s), then the system is robustly stable with the controller C(s) if 
and only if the complementary sensitivity function T(s) for the nominal plant G m (s) 
satisfies the following bound 



|r(j<j)4(w)||oo = sup|r(j<j)4(w)| < 1 



(9.141) 



where the LHS of equation (9.141) is the infinity norm of T()oo)I m ()uo). This means 
that robust stability imposes a bound on the oo norm of the complementary sensi- 
tivity function T{]uj) weighted by £ m (uj)\ 
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9.8.2 Robust performance 



Robust stability provides a minimum requirement in an environment where there is 
plant model uncertainty. For a control system to have robust performance it should 
be capable of minimizing the error for the worst plant (i.e. the one giving the largest 
error) in the family G(')u) e tt. 

For the 7/oo-control problem, from equation (9.131), the oo-norm of the weighted 
sensitivity function can be written 

115^11^= sup|5(jo;)^(ja;)| (9.142) 

If, as part of the design process, a bound is placed upon the sensitivity function 

\S(JLu)\<\W(JLu)\- 1 (9.143) 

Should an H^ controller be found such that 

IWIoo< 1 (9-144) 

then the bound in equation (9.143) is met. Hence, for robust performance 

115^11^= sup\S(joj)W()oj)\ < 1 for all G(jto) € tt (9.145) 

CO 

From Figure 9.23 representing robust stability, the actual frequency response 
G(juj)C(juj) will always lie inside the region of uncertainty denoted by the disk, or 

|1 + G(ju)C(juj)\ > |1 + G m Qu)CQu)\ - |G m (jw)C(jw)|4(w) for all G(ju) G tt 

(9.146) 



giving 

\S(jv)\ 1 



1 + G(](j)C(](J) 



< Iri^ip,^ ^ all G(jc) G ^ (9.147) 

1 - \T m ()(j)\l m (u) 



where S m (]uo) is the sensitivity function for the nominal plant 



£n(j") = i Mr n \r(\ \ (9 - 148) 

1 + G m (jcj)C(jcj) 

Using equation (9.147), equation (9.145) can be expressed as 

\M^mm <i for all. (9.149) 

i - \T m ()oj)\e m (u) 

or 

| T m {]Lo)l m (Lo)\ + \S m (&) WQw)\ < 1 for all w (9. 1 50) 
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Fig. 9.24 Control system. 



Robust performance then means that the closed-loop system will meet the perform- 
ance specification given in equation (9.145) if and only if the nominal system is 
closed-loop stable (equation (9.141)) and that the sensitivity function S m (iu) and 
complementary sensitivity function T m (]uj) for the nominal system satisfy the rela- 
tionship given in equation (9.150). 

Example 9.4 

(a) For the control system shown in Figure 9.24 produce the Bode magnitude plots 
for the sensitivity function |*S(ja;)| and the complementary sensitivity function 
|r(jcj)| when K = 10. Comment on their values. 

(b) For a step input, let W(s) = l/s. Produce Bode magnitude plots for | i S(jcj)W / (jcj)| 
when K = 10, 50 and 100 and identify the optimal value using both H2 and H^ 
criteria. 

Use a frequency range of 0.01-100 rad/s for both (a) and (b). 

Solution 

(a) From equation (9.107) 



S(s) = 



1 



1 + G(s)C(s) 

2s 2 + 3s + 
2s 2 + 3s + (l+K) 



K 
(1+j)(1+2j) 



1 



(9.151) 



From equation (9.108) 



T(s) = 1 - S(s) = 1 - 
K 



2s 2 + 3s+\ ] 
2s 2 + 3s + (\+K); 



2s 2 + 3s + (\+K) 



(9.152) 



The Bode magnitude plots for |5(jw)| and |7\jw)| are shown in Figure 9.25 for 
K = 10. From Figure 9.25 it can be seen that up to 1 rad/s, the system has a set- 
point tracking error of — 0.8dB (|!T(jw)|) and a disturbance rejection of 
-20dB(|S(jw)|). 
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(b) For a specific input of a unit step, let W(s) = l/s. Hence the weighted sensitivity 
function is 



S(s)W(s) 



2s 2 + 3s+l 



s{2s 2 + 3s + (1 + K)} 



(9.153) 



The Bode magnitude plots for |S(ju;)^(jci;)| for K = 10, 50 and 100 are shown in 
Figure 9.26. 

From Figure 9.26 it can be seen that the 7/2-norm, or average value of the weighted 
sensitivity function (equation (9.130)) reduces as ^increases and hence, using this 
criteria, K = 100 is the best value. Using the 7/oo-norm as defined in equation (9.131), 
the maximum magnitude of the weighted sensitivity function occurs at the lowest 
frequency. The least upper bound therefore is OdB, occurring at 0.01 rad/s when 
K = 100, so this again is the best value. 



Example 9.5 

A closed-loop control system has a nominal forward-path transfer function equal to 

that given in Example 6.4, i.e. 



G m (s)C(s) 



K 



s(s 2 + 2s + 4) 



10 



Gain 
(dB) 
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Fig. 9.25 Bode magnitude plots for |S(jcj)| and |7"(ju;)|. 
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Let the bound of the multiplicative model uncertainty be 

0.5(1+,) 

What is the maximum value that K can have for robust stability? 

Solution 

At frequencies below 1 rad/s, I m (uS) — > 0.5 and at frequencies above 4rad/s 

£ m (uj) — > 2.0. From equation (9.141), for robust stability 

\T(]u)Uu>)\ < 1 

now 

G m (s)C(s) 



therefore 



T(s) 



T(s) 



1 + G m (s)C(s) 



T(s) 



K 

s 3 +2s 2 +4s 

j K 

^ j 3 +2 j 2 +4 j 

a: 



(9.154) 



s 3 + 2s 2 + 4, + a: 
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Fig. 9.26 Bode magnitude plot of weighted sensitivity function for Example 9.4. 
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Fig. 9.27 Bode plot of |7~(j^mM| for Example 9.5. 

thus 

T(s)£ m (s) 



0.5K(l+s) 



(1 + 0.25s)(s 3 + 2s 2 + 4s + K) (9 ' 155) 

The Bode magnitude plot for equation (9.155) is shown in Figure 9.27 when K = 2 
and 3.5. 

In Example 6.4, when there was no model uncertainty, K for marginal stability was 
8, and for a gain margin of 6dB, K was 4. In this example with model uncertainty, 
from equation (9.154) marginal stability occurs with K = 3.5, so this is the maximum 
value for robust stability. For robust performance, equation (9.150) applies. For a 
specific step input let W(s) = l/s now 



and 



hence 



S m (s) 



S m (s)W(s) 



s 3 + 2s 2 + 4s 


s 3 + 2s 2 + As + K 


s(s 2 + 2s + 4) 



(9.156) 



S m (sW(s) = 



s(s 3 + 2s 2 + As + if) 

s 2 + 2s + 4 



9 3 + 2s 2 + 4s + K 



(9.157) 



The Bode magnitude plot of the weighted sensitivity function is shown in Figure 9.28 
for K = 2, 2.5 and 3.5. 
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Fig. 9.28 Bode magnitude plot of weighted sensitivity function for Example 9.5. 
For robust performance 

\T m (j(J) +4(")| + \S m (j<J)W(]<J)\ < 1 for all , 

From Table 9.2 it can be concluded that: 



(9.158) 



(a) The control system has robust stability up to K = 3.5. 

(b) The //oo-norm is >1 for all values of K considered. Therefore equations (9.145) 
and (9.150) are not met and the system cannot be considered to have robust 
performance. 

From (b) above, it must be concluded that the controller C(s) must be something 
more sophisticated than a simple gain constant K. 



Table 9.2 Robust performance for Example 9.5 



uj (rad/s) 




0.01 






1.5 




K 


2 


2.5 


3.5 


2 


2.5 


3.5 


\T m Qu)£ m (u)\ 


0.5 (-6dB) 


0.5 (not shown in 
Figure 9.27) 


0.5 


0.5 


0.63 (not shown in 
Figure 9.27) 


1.0 


\S m Qco)WQu;)\ 


2.0 (6 dB) 


1.58 


1.12 


0.96 


1.05 


1.26 


Sum 


2.5 


2.08 


1.62 


1.46 


1.68 


2.26 
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9.9 Multivariate robust control 



9.9.1 Plant equations 



The canonical robust control problem is shown in Figure 9.29. 

In Figure 9.29, u 2 are the inputs to the plant P m from the controller and Ui are the 
disturbance and noise inputs. Also, yi are the outputs to be controlled and y 2 are the 
outputs that are fed back to the controller. 

If P m (s) and the plant uncertainty A(s) are combined to give P(V), then Figure 9.29 
can be simplified as shown in Figure 9.30, also referred to as the two-port state-space 
representation. 

The state and output equations are 



x = Ax + BiUi + B2U2 

y x =Cix + DnUi +D12U2 
y 2 = C 2 x + D 2 iiii +D 22 u 2 



(9.159) 



Equation (9.159) can be combined 



X 




A 


Bi 


B 2 




X 


yi 


= 


Ci 


Dn 


D 12 




Ul 


yi. 




[c 2 


D21 


D 22 




u 2 



(9.160) 



Uncertainty 





A(s) 








Plant 


PmW 












Controller 


C(s) 




^ ' 



Fig. 9.29 The canonical robust control problem. 
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Fig. 9.30 Two-port state-space augmented plant and controller. 
Hence the augmented plant matrix P(s) in Figure 9.30 is 



P(J): 



Ci 

c 2 



Bi B2 



Dn D 12 
D21 D22 



P11 
P21 



P12 

P22 



(9.161) 



From the partitioned matrix in equation (9.161), the closed-loop transfer function 
matrix relating yi and Ui is 



where 



Ty lUl = P u (s) + Puis) (I - C(s)P 22 (s)y l C(s)P 2l (s\ 



112OO = C(s)y 2 (s) 



(9.162) 
(9.163) 



9.9.2 Singular value loop shaping 



The singular values of a complex n x m matrix A, denoted by 07(A) are the non- 
negative square-roots of the eigenvalues of A T A ordered such that 



0"i > &i > • • • > crp P — min{^, m} 



(9.164) 



The maximum singular value a of A and the minimum singular value a of A are 
defined by 



a(A) = ||A|| 2 



£(A)= IIA-'Hj 1 if A" 1 exists 



As with a SISO system, a sensitivity function may be defined 

S(.) = (I + G(.)C(.))- 1 



(9.165) 



(9.166) 
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where GO) is the non-augmented plant matrix. For good performance SO) should 
be as small as possible. The complementary sensitivity function is 

TO) = GO) CO) (I + G0)C0)) _1 (9.167) 

where 

S0) + T0) = I (9.168) 

The singular value of the sensitivity function a (S( jo;)) and of the complementary 
sensitivity function <j(T(jo;)) can be displayed as Bode plots and play an important 
role in robust multivariable control system design. 

The singular values of S determine the disturbance attenuation, and thus a per- 
formance specification may be written 

iKSipj)) < IW-'CJ^I (9.169) 

where |\V~ 1 (jo;)| is a desired disturbance attenuation factor. If A m 0) is a diagonal 
matrix of multiplicative plant uncertainty as illustrated in Figure 9.29, it can be 
shown that the size of the smallest stable A m 0) for which the system becomes 
unstable is 

a(A m (j^)) = l/a(T(j^)) (9.170) 

or alternatively 

a(T(juj))<\\Vj l (juj)\ (9.171) 

where |W T (j^)| is the size of the largest anticipated multiplicative plant uncertainty. 

9.9.3 Multivariable H 2 and H^ robust control 

The 7/2-optimal control problem is to find a stabilizing controller CO) in equation 
(9.163) for an augmented plant PO) in equation (9.161), such that the closed-loop 
transfer function matrix Ty^i in equation (9.162) is minimized. 
Thus 

min HTyjUil^ = mrJ - / tv&CQ(Jy x u x ()uj) T Ty x xix(}uj))&uj \ (9.172) 

CO) CO) [ttJq ) 

where T is the complex conjugate transpose, and trace is the sum of the diagonal 
elements. The H^ robust control problem is to find a stabilizing controller CO) for 
an augmented plant PO), such that the closed-loop transfer function matrix Ty^i 
satisfies the infinity-norm inequality 

||Ty 1 ui|| 00 = sup a max (Ty lUl (j^)) < 1 (9.173) 

CO 

Equation (9.173) is also called the 'small gain' infinity-norm control problem. 
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9.9.4 The weighted mixed-sensitivity approach 

Multivariable loop shaping in robust control system design may be achieved using 
a weighted mixed sensitivity approach. As with the SISO systems described in section 
9.8.2, the sensitivity function S(s) given in equation (9.166) and the complementary 
sensitivity function T(s) given in equation (9.167) may be combined with weights 
W s (j) and WjC?) to give 



Tyiu 



i"i 



W 8 (.s) 
WtCs) 



S(s) 

T(s) 



(9.174) 



where the infinity norm of Ty^i is <1 as given in equation (9.173). Equation (9.174) 
defines a mixed-sensitivity cost function since both S(s) and T(s) are penalized. Note 
that if W s (j) weights the error and WjC?) the output, the two-port augmented plant 
given in Figure 9.30 may be represented by Figure 9.31. 

Example 9.6 (See also Appendix 1, examp96.m) 
A plant has a transfer function 



G(s) = 



200 



s 3 + 3s 2 + 102^ + 200 



(9.175) 



given the sensitivity and complementary weighting functions 

100 + s* 



W s (s) = 7 



1 + 100s 



'1 + 100A 

Wt(s) = ( TooT7 ) 



(9.176) 



























Augmented Plant 




W s (s) 
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Fig. 9.31 Weighted mixed-sensitivity approach. 
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determine the singular value Bode magnitude plots for 

(a) the plant G(jcj) 

(b) the weighting functions W~ x (')uj) and Wj 1 (juj) 

(c) the cost function Ty^iQV) at its optimal value of 7 (given in W s (s)) 

(d) the 7/oo-optimal controller C(]uj) 

Find also the state-space and transfer function expressions for the controller. 

Solution 

The state-space representation of the plant G(s) is 







-3 


-102 


-200 


: 1 


Ag Bg 
Cd Dg 


= 


1 





1 






: 
: 











200 







(9.177) 



The singular value frequency response G{juj) is shown in Figure 9.32. 

The frequency response of the reciprocal of the weighting functions W~ l (]J) 
(7=1) and Wj 1 (}uj) are given in Figure 9.33. 

The optimal value of Ty^i is achieved when (7 = 0.13) and its singular value 
frequency response is shown in Figure 9.34. 

The controller single value frequency response C(')uj) is illustrated in Figure 9.35. 
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Fig. 9.32 Plant singular value Bode magnitude plot. 
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Fig. 9.33 Weighting functions Bode magnitude plots. 
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Fig. 9.34 Singular value Bode magnitude plot of |Tyi Ui ( jcj)| when 7 = 0.13. 
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Fig. 9.35 Controller single value Bode magnitude plot |C(jcj)|. 
The state-space representation of the controller C(s) is 



10" 



A c B c 
C c D c 



10 J 



-0.01 


-0.002 


0.004 


0.015 


0.137 


-7.976 


-0.009 


-7.763 


21.653 


37.164 


621.89 


0.091 


-0.046 


-2.032 


-3.148 


-2.234 


-81.88 


0.582 


0.435 


0.107 


8.807 


-102.25 


-37.78 


-8.8 


0.676 


0.197 


13.558 


-3.728 


-162.51 


-13.66 


-0.086 


0.169 


0.121 


-0.654 


-11.17 






(9.178) 
and the controller transfer function is 

159/ + 16.4 x 10V +63.9x 10V + 1.6x 10^ + 3.18 x 10 6 
W ~ s 5 + 215s 4 + 20.4 x 10V + 324.8 x 10V + 3.78 x 10 6 s + 37.8 x 10 3 

(9.179) 

The results in this example were obtained using the MATLAB Robust Control 
Toolbox. 
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Further probler 



Example 9 J 

In a multivariable optimal regulator system, the plant state equations are 



x 2 _ 


= 


" 1 " 
.-4 -2_ 


'x\' 

-*2. 


+ 


"0 
.4 


y = [l 0]x 









(9.180) 



If the performance index to be minimized is 

J= (x T Qx + u 2 )dt 

Jo 



(9.181) 



(a) Determine, by hand, the elements of the Riccati matrix P in the reduced Riccati 
equation 



PA + A T P + Q - PBR ! B T P = 



given that 



2 
1 



(b) Find the optimal feedback matrix K so that 

K = R ! B T P 

and hence calculate the closed-loop eigenvalues. 



(9.182) 



(9.183) 



(9.184) 



Solutions 



1.703 0.183 
0.183 0.193 



(a) P 

(b) K = [0.732 0.772] 

s= -2.544 ±j0.675 



Example 9.8 

A plant and measurement system are described by 

x = Ax + Bu + CdW 
y = Cx 

z = y + v 



(9.185) 
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where w(7) is a Gaussian sequence of disturbances and \(t) is a Gaussian sequence of 
measurement noise. z(t) is the measured value of y(t) that is contaminated with 
measurement noise \(t). The plant parameters are 



1 















1 


B = 







-50 -102 


-4.5_ 




100 




0.5 " 






"10 


0.5 




C = 


1 


10 









1 



(9.186) 



The measurement noise and disturbance covariance matrices are 



R 



0.1 










0.1 











0.1 





Q = 





0.1 











6 










2 



(9.187) 



(a) For a sampling time of 0.1 seconds, using equations (8.78) and (8.80) calculate 
the discrete-time state transition, control and disturbance matrices A(T), B(T) 
and C d (T). 

(b) Starting with an initial covariance matrix P(k/k) equal to the identity matrix, 
perform 20 recursions of equations (9.74), (9.75) and (9.76) to compute the 
Kalman gain matrix K(k + 1) and covariance matrix P(k + 1/A: + 1). 



Solutions 
















" 0.993 


0.085 


0.004" 




"0.014 


(a) A(T) = 


-0.199 


0.587 


0.067 


B(77) = 


0.398 




_ -3.370 


-7.074 


0.284 _ 




_ 6.740 




" 0.050 


0.002 


0.001" 




C d (T) = 


-0.004 


0.043 


0.040 






_ -0.100 


-0.207 


0.674 _ 






" 0.040 


-0.006 


-0.002" 




(b) K(/c+l) = 


-0.006 


0.137 


0.003 






—0.133 


0.155 


0.218 _ 






" 0.004 


-0.001 


-0.013" 




P(*+l/fc+l) = 


-0.001 


0.014 


0.016 








-0.013 


0.016 


1.310 







Example 9.9 

The plant described in Example 9.8 by equations (9.185) and (9.186) is to be 
controlled by a Linear Quadratic Gaussian (LQG) control scheme that consists of 
a LQ Regulator combined with the Kalman filter designed in Example 9.8. The 
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quadratic performance index to be minimized for the LQ regulator is of the form 
given in equation (9.181) where 



Q 



10 


0] 





5 





1 



(R=l) 



(9.188) 



Using the recursive equations (9.29) and (9.30), solve, in reverse time, the Riccati 
equation commencing with P(iV) = 0. 

If the sampling time is 0.1 seconds, the values of the discrete-time state transition 
and control matrices A(T) and B(T) calculated in Example 9.8 may be used in the 
recursive solution. 

Continue the recursive steps until the solution settles down (when k = 50, or 
kT = 5 seconds) and hence determine the steady-state value of the feedback matrix 
K(0) and Riccati matrix P(0). What are the closed-loop eigenvalues? 



Solutions 

K(0) = [-0.106 -0.581 0.064] 



P(0) 



11.474 3.406 0.153 
3.406 3.952 0.163 
0.153 0.163 0.1086 



closed-loop eigenvalues =-1.230 

-4.816 ±7'2.974 



Example 9.10 

A unity-feedback control system has a nominal plant transfer function 



G m (s) 



1 



(s + 2)(s + 5) 
and an integral controller in the forward path 

C(s) = * 



(9.189) 



(9.190) 



If the bound of the multiplicative model uncertainty is 



a(s) 



0.25(1 + 4s) 
(1 + 0.25s) 



(9.191) 
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determine: 

(a) Expressions for the sensitivity and complementary sensitivity function S(s) and 
T(s) for the nominal plant. 

(b) The maximum value that K can have for robust stability. 



Solutions 



(a) S(s) 



T(s) 



s 3 + Is 2 + 10s 

s 3 +7s 2 + \0s + K 
K 



s 3 +ls 2 + 10s + K 
(b) K max = 4.5 



Example 9.11 

A plant has a transfer function 



G(s) 



100 



s 2 + 2s+\00 
and sensitivity and complementary weighting functions 

\ s+l 

Find the optimal value for 7 and hence the state-space and transfer functions for the 
/foo-optimal controller C(s). 

Solutions 
7opt = 0.0576 



A c B c 
C c D c 



-2.8 


3.0 


-1.4 


150.9 


-4.55 


-3.0 


-22.2 


50.1 


258.0 


3.10 


-2.7 


39.6 


-74.5 


196.1 


2.99 


-3.2 


-36.3 


-23.2 


-1871.1 


7.44 


-0.33 


1.68 


1.02 


-49.42 






C(s) 



1.86 x IOV + 0.1898 x 10V + 0.5581 x \0 6 s + 18.6031 x 10 6 
7TT97 x 10 3 ^ 3 + 0.2005 x 10V + 1.3531 x 10 6 s+ 1.1546 x 10 6 
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design 



Intelligent control systems 
10.1.1 Intelligence in machines 



According to the Oxford dictionary, the word intelligence is derived from intellect, 
which is the faculty of knowing, reasoning and understanding. Intelligent behaviour 
is therefore the ability to reason, plan and learn, which in turn requires access to 
knowledge. 

Artificial Intelligence (AI) is a by-product of the Information Technology (IT) 
revolution, and is an attempt to replace human intelligence with machine intelli- 
gence. An intelligent control system combines the techniques from the fields of AI 
with those of control engineering to design autonomous systems that can sense, 
reason, plan, learn and act in an intelligent manner. Such a system should be able 
to achieve sustained desired behaviour under conditions of uncertainty, which 
include: 

(a) uncertainty in plant models 

(b) unpredictable environmental changes 

(c) incomplete, inconsistent or unreliable sensor information 

(d) actuator malfunction. 

10.1.2 Control system structure 

An intelligent control system, as considered by Johnson and Picton (1995), comprises 
of a number of subsystems as shown in Figure 10.1. 

The perception subsystem 

This collects information from the plant and the environment, and processes it into a 
form suitable for the cognition subsystem. The essential elements are: 

(a) Sensor array which provides raw data about the plant and the environment 

(b) Signal processing which transforms information into a suitable form 

(c) Data fusion which uses multidimensional data spaces to build representations of 
the plant and its environment. A key technology here is pattern recognition. 
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Intelligent Control System 
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Fig. 10.1 Intelligent control system structure (adapted from Johnson and Picton). 

The cognition subsystem 

Cognition in an intelligent control system is concerned with the decision making 
process under conditions of uncertainty. Key activities include: 

(a) Reasoning, using 

(i) knowledge-based systems 
(ii) fuzzy logic 

(b) Strategic planning, using 

(i) optimum policy evaluation 
(ii) adaptive search and genetic algorithms 
(iii) path planning 

(c) Learning, using 

(i) supervised learning in neural networks 
(ii) unsupervised learning in neural networks 
(iii) adaptive learning 

The actuation subsystem 

The actuators operate using signals from the cognition subsystem in order to drive the 
plant to some desired states. In the event of actuator (or sensor) failure, an intelligent 
control system should be capable of being able to re-configure its control strategy. 

This chapter is mainly concerned with some of the processes that are contained 
within the cognition subsystem. 



10.2 Fuzzy logic control systems 



10.2.1 Fuzzy set theory 



Fuzzy logic was first proposed by Zadeh (1965) and is based on the concept of fuzzy 
sets. Fuzzy set theory provides a means for representing uncertainty. In general, 
probability theory is the primary tool for analysing uncertainty, and assumes that the 
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uncertainty is a random process. However, not all uncertainty is random, and fuzzy 
set theory is used to model the kind of uncertainty associated with imprecision, 
vagueness and lack of information. 

Conventional set theory distinguishes between those elements that are members of 
a set and those that are not, there being very clear, or crisp boundaries. Figure 10.2 
shows the crisp set 'medium temperature'. Temperatures between 20 and 30 °C lie 
within the crisp set, and have a membership value of one. 

The central concept of fuzzy set theory is that the membership function //, like 
probability theory, can have a value of between and 1. In Figure 10.3, the member- 
ship function ji has a linear relationship with the x-axis, called the universe of 
discourse U. This produces a triangular shaped fuzzy set. 

Fuzzy sets represented by symmetrical triangles are commonly used because they 
give good results and computation is simple. Other arrangements include non- 
symmetrical triangles, trapezoids, Gaussian and bell shaped curves. 

Let the fuzzy set 'medium temperature' be called fuzzy set M. If an element u of the 
universe of discourse U lies within fuzzy set M, it will have a value of between and 
1 . This is expressed mathematically as 



MmO) e [0, 1] 



(10.1) 



When the universe of discourse is discrete and finite, fuzzy set M may be expressed as 

n 

M = J2m(u i )/u i (10.2) 



i=\ 



In equation (10.2) '/' is a delimiter. Hence the numerator of each term is the member- 
ship value in fuzzy set M associated with the element of the universe indicated in the 
denominator. When n = 11, equation (10.2) can be written as 



M = 0/0 + 0/5 + 0/10 + 0.33/15 
+ 0/40 + 0/45 + 0/50 



• 0.67/20 + 1/25 + 0.67/30 + 0.33/35 



(10.3) 



Membership 
Function 



n 

1.0- 


Medium 
Temperature 


i 








0.8- 








0.6- 








0.4- 








0.2- 









10 



20 30 

Temperature (°C) 



40 



50 



Fig. 10.2 Crisp set 'medium temperature'. 
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Function 
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Temperature 
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50 



Fig. 10.3 Fuzzy set 'medium temperature'. 

Note the symbol '+' is not an addition in the normal algebraic sense, but in fuzzy 
arithmetic denotes a union operation. 



10.2.2 Basic fuzzy set operations 



Let A and B be two fuzzy sets within a universe of discourse U with membership 
functions //a and //b respectively. The following fuzzy set operations can be defined as 

Equality. Two fuzzy sets A and B are equal if they have the same membership 
function within a universe of discourse U. 



Hk(u) = hr(u) for all u e U 



(10.4) 



Union: The union of two fuzzy sets A and B corresponds to the Boolean OR function 
and is given by 



MaubO) = ma+bO) = max{/i A (w), MbO)} for all u e U 



(10.5) 



Intersection: The intersection of two fuzzy sets A and B corresponds to the Boolean 
AND function and is given by 



Mahb(w) = min{fi A (u), Hk(u)} for all u e U 



(10.6) 



Complement: The complement of fuzzy set A corresponds to the Boolean NOT 
function and is given by 



/i-,A(w) = 1 — ^a(w) for all u e U 



(10.7) 



Example 10.1 

Find the union and intersection of fuzzy set low temperature L and medium tem- 
perature M shown in Figure 10.4. Find also the complement of fuzzy set M. Using 
equation (10.2) the fuzzy sets for n = 11 are 
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10 20 30 40 

Universe of Discourse (Temperature (°C)) 



Fig. 10.4 Overlapping sets 'low' and 'medium temperature'. 



50 



(10.8) 



L = 0/0 + 0.33/5 + 0.67/10 + 1/15 + 0.67/20 + 0.33/25 

+ 0/30 + 0/35 + ••• + 0/50 
M = 0/0 + 0/5 + 0/10 + 0.33/15 + 0.67/20 + 1/25 + 0.67/30 

+ 0.33/35 + 0/40 + • • • + 0/50 

(a) Uniom Using equation (10.5) 

Ml+m(w) =max(0, 0)/0 + max(0.33, 0)/5 + max(0.67, 0)/10 

+ max(l, 0.33)/15 + max(0.67, 0.67)/20 + max(0.33, l)/25 
+ max(0, 0.67)/30 + max(0, 0.33)/35 + max(0, 0)/40 + • • • 
+ max(0, 0)/50 

Ml+m(w) = 0/0 + 0.33/5 + 0.67/10 + 1/15 + 0.67/20 + 1/25 + 0.67/30 
+ 0.33/35 + 0/40 + • • • + 0/50 

(b) Intersection: Using equation (10.6) and replacing 'max' by 'min' in equation 
(10.9) gives 



(10.9) 



(10.10) 



Mlhm(w) = 0/0 + 0/5 + 0/10 + 0.33/15 + 0.67/20 + 0.33/25 

+ 0/30 + ••• + 0/50 (10.11) 

Equations (10.10) and (10.11) are shown in Figure 10.5. 
(c) Complement: Using equation (10.7) 

^ M (u) = (1 - 0)/0 + (1 - 0)/5 + (1 - 0)/10 + (1 - 0.33)/15 

+ (1 - 0.67)/20 + (1 - l)/25 + (1 - 0.67)/30 + (1 - 0.33)/35 

+ (1 - 0)/40 + • • • + (1 - 0)/50 (10.12) 

Equation (10.12) is illustrated in Figure 10.6. 
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1.0 - 


L 


M 




0.8 - 






^^L+u(U) 


0.6 - 






/\^^-^m(U) 


0.4- 








0.2 - 









10 20 30 40 

Temperature (°C) 



50 



Fig. 10.5 'Union'and 'intersection' functions. 
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Fig. 10.6 The complement of fuzzy set M. 

10.2.3 Fuzzy relations 



20 30 

Temperature (°C) 



An important aspect of fuzzy logic is the ability to relate sets with different universes 
of discourse. Consider the relationship 



IF L THEN M 



(10.13) 



In equation (10.13) L is known as the antecedent and M as the consequent. The 
relationship is denoted by 



or 



LxM 



LxM 



min{// L (wi), // M (vi)} • • • min{// L (wi), fi M (vk)} 
mm{fi L (uj), // M (vi)} . . . mm{fi L (uj), mM} 



(10.14) 



(10.15) 
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Vk are the discretized universe of discourse. Consider the 



IF L is low THEN M is medium 



(10.16) 



Then for the fuzzy sets L and M defined by equation (10.8), for U from 5 to 35 in 
steps of 5 



LxM 



which gives 



min(0.33, 0) 
min (0.67, 0) 

min (0,0) 



min(0.33, 1) 
min (0.67, 1) 

min(0, 1) 



min (0.33, 0.33) 
min (0.67, 0.33) 

min (0,0.33) 



(10.17) 



LxM: 



(10.18) 



0.33 0.33 0.33 0.33 0.33 

0.33 0.67 0.67 0.67 0.33 

0.33 0.67 1 0.67 0.33 

0.33 0.67 0.67 0.67 0.33 

0.33 0.33 0.33 0.33 0.33 







Several such statements would form a control strategy and would be linked by their 
union 



• A 2 + A 3 



■A n 



(10.19) 



10.2.4 Fuzzy logic control 



The basic structure of a Fuzzy Logic Control (FLC) system is shown in Figure 10.7. 

The fuzzification process 

Fuzzification is the process of mapping inputs to the FLC into fuzzy set membership 
values in the various input universes of discourse. Decisions need to be made 
regarding 

(a) number of inputs 

(b) size of universes of discourse 

(c) number and shape of fuzzy sets. 

A FLC that emulates a PD controller will be required to minimize the error e(t) and 
the rate of change of error de/dt, or ce. 

The size of the universes of discourse will depend upon the expected range (usually 
up to the saturation level) of the input variables. Assume for the system about to be 
considered that e has a range of ±6 and ce a range of ±1. 

The number and shape of fuzzy sets in a particular universe of discourse is a trade- 
off between precision of control action and real-time computational complexity. In 
this example, seven triangular sets will be used. 
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Fig. 10.7 Fuzzy Logic Control System. 

Each set is given a linguistic label to identify it, such as Positive Big (PB), Positive 
Medium (PM), Positive Small (PS), About Zero (Z), Negative Small (NS), Negative 
Medium (NM) and Negative Big (NB). The seven set fuzzy input windows for e and 
ce are shown in Figure 10.8. If at a particular instant, e(t) = 2.5 and de/dt = -0.2, 
then, from Figure 10.8, the input fuzzy set membership values are 



/ips0) = 0.7 // P mOO = 0.4 
MnsOO = 0.6 fi z {ce) = 0.3 



(10.20) 



The fuzzy rulebase 

The fuzzy rulebase consists of a set of antecedent-consequent linguistic rules of 
the form 



IF e is PS AND ce is NS THEN u is PS 



(10.21) 



This style of fuzzy conditional statement is often called a 'Mamdani'-type rule, after 
Mamdani (1976) who first used it in a fuzzy rulebase to control steam plant. 

The rulebase is constructed using a priori knowledge from either one or all of the 
following sources: 

(a) Physical laws that govern the plant dynamics 

(b) Data from existing controllers 

(c) Imprecise heuristic knowledge obtained from experienced experts. 

If (c) above is used, then knowledge of the plant mathematical model is not required. 
The two seven set fuzzy input windows shown in Figure 10.8 gives a possible 7x7 
set of control rules of the form given in equation (10.21). It is convenient to tabulate 
the two-dimensional rulebase as shown in Figure 10.9. 

Fuzzy inference 

Figure 10.9 assumes that the output window contains seven fuzzy sets with the same 
linguistic labels as the input fuzzy sets. If the universe of discourse for the control 
signal u(t) is ±9, then the output window is as shown in Figure 10.10. 
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/i(e) 1.0 



n(ce) -| o 




-0.67 -0.33-0.2 0.33 0.67 

Rate of Change Of Error (ce) 

Fig. 10.8 Seven set fuzzy input windows for error (e) and rate of change of error (ce). 

Assume that a certain rule in the rulebase is given by equation (10.22) 

OR IF e is A AND ce is B THEN u = C (10.22) 

From equation (10.5) the Boolean OR function becomes the fuzzy max operation, 
and from equation (10.6) the Boolean AND function becomes the fuzzy min oper- 
ation. Hence equation (10.22) can be written as 



fjLc(u) = max[min(/i A (e) 5 Atefce))] 



(10.23) 



Equation (10.23) is referred to as the max-min inference process or max-min fuzzy 
reasoning. 

In Figure 10.8 and equation (10.20) the fuzzy sets that were 'hit' in the error input 
window when e(t) = 2.5 were PS and PM. In the rate of change input window when 
ce = -0.2, the fuzzy sets to be 'hit' were NS and Z. From Figure 10.9, the relevant 
rules that correspond to these 'hits' are 
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Fig. 10.9 Tabular structure of a linguistic fuzzy rulebase. 



fjL(u) 1.0 




-3 3 

Control Signal (u) 

Fig. 10.10 Seven set fuzzy output window for control signal (u). 



OR IF e is PS AND ce is NS 
OR IF e is PS AND ce is Z 
THEN u = PS 



(10.24) 



OR IF e is PM AND ce is NS 
OR IF e is PM and ce is Z 
THEN u = VM 



(10.25) 
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Applying the max-min inference process to equation (10.24) 

MpsO) = max[min(/ip S (V), MNs(^)),min(// PS (e), ^z(ce))] (10.26) 

inserting values from equation (10.20) 

Mps(w) = max[min(0.7, 0.6), min(0.7, 0.3)] 

= max[0.6, 0.3] = 0.6 (10.27) 

Applying the max-min inference process to equation (10.25) 

MpmO) = max[min(/i PM (e), Mns («?)), min(/i PM (e), Vz(ce))] (10.28) 

inserting values from equation (10.20) 

Mpm(w) = max[min(0.4, 0.6),min(0.4, 0.3)] 

= max[0.4, 0.3] = 0.4 (10.29) 

Fuzzy inference is therefore the process of mapping membership values from the 
input windows, through the rulebase, to the output window(s). 

The defuzzification process 

Defuzzification is the procedure for mapping from a set of inferred fuzzy control 
signals contained within a fuzzy output window to a non-fuzzy (crisp) control signal. 
The centre of area method is the most well known defuzzification technique, which in 
linguistic terms can be expressed as 

_ . , • , Sum of first moments of area ...... 

Crisp control signal = (10.30) 

Sum oi areas 

For a continuous system, equation (10.30) becomes 

fuu(u)du 
"(')= f A (1031) 

J /i(w)aw 

or alternatively, for a discrete system, equation (10.30) can be expressed as 

u(kT) = ^ Uif f U > ) (10.32) 

Ei=i M«0 

For the case when e{t) = 2.5 and ce = —0.2, as a result of the max-min inference 
process (equations (10.27) and (10.29)), the fuzzy output window in Figure 10.10 is 
'clipped', and takes the form shown in Figure 10.11. 

From Figure 10.11, using the equation for the area of a trapezoid 

Are, PS = «5±ld> = 2 .52 
Area PM= 02(6 : 36 > = 0.96 ""'^ 



From equation (10.30) 



(^52x3^0^x6)^33 
w 2.52 + 0.96 v J 
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Fig. 10.11 Clipped fuzzy output window due to fuzzy inference. 



Hence, for given error of 2.5, and a rate of change of error of -0.2, the control signal 
from the fuzzy controller is 3.83. 

Example 10.2 

For the input and output fuzzy windows given in Figure 10.8 and 10.10, together 

with the fuzzy rulebase shown in Figure 10.9, determine 

(a) the membership values of the input windows e and ce. 

(b) the max-min fuzzy inference equations 

(c) the crisp control signal u(t) 

when e — — 3 and ce = 0.3 

Solution 

(a) When e = — 3 and ce = 0.3 are mapped onto the input fuzzy windows, they are 
referred to as fuzzy singletons. From Figure 10.8 



-3 //nsO) = 0.5 // N m0) = 0.5 



(10.35) 



ce = 0.3, using similar triangles 



1 



Hz(ce) 



0.33 (0.33-0.3) 
[nice) = 0.09 



(10.36) 



and 



1 _ yj>s(ce) 
0.33 ~ 0.3 
Mps(«?) = 0.91 



(10.37) 
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(b) The rules that are 'hit' in the rulebase in Figure 10.9 are 

... OR IF ^ is NS and ce is Z 

OR IF e is NS and ce is PS 

THEN u = NS (10.38) 

. . . OR IF e is NM and ce is Z 
OR IF e is NM and ce is PS 
THEN w = NM (10.39) 

Applying max-min inference to equation (10.38) 

Mns(w) = max[ min(// NS (<?), Vz(ce)), min(// NS (<?), //ps(^))] (10.40) 

Inserting values into (10.40) 

//ns(w) = max[min(0.5, 0.09), min(0.5, 0.91)] 
= max[0.09,0.5] = 0.5 

and similarly with equation (10.39) 

Mnm(w) = max[min(// NM (<?), Mz(ce)), min(// NM (<?), Ws(ce))] 

= max[min(0.5, 0.09), min(0.5, 0.91)] (10.42) 

= max[0.09,0.5] = 0.5 

Using equations (10.41) and (10.42) to 'clip' the output window in Figure 10.10, the 
output window is now as illustrated in Figure 10.12. 

(c) Due to the symmetry of the output window in Figure 10.12, from observation, 
the crisp control signal is 

u{t) = -4.5 

Example 10.3 (See also Appendix 1, exampl03.m) 

Design a fuzzy logic controller for the inverted pendulum system shown in Figure 

10.13 so that the pendulum remains in the vertical position. 

The inverted pendulum problem is a classic example of producing a stable closed- 
loop control system from an unstable plant. 

Since the system can be modelled, it is possible to design a controller using the pole 
placement techniques discussed in Chapter 8. Neglecting friction at the pivot and the 
wheels, the equations of motion from Johnson and Picton (1995) are 

.. ^ + m^(<9 2 sin<9-£cos<9) 

x = — (10.43) 

.. gsin^ + cos^( - F -^ sm ^ 



<!- 



mcos 2 9 
M+m 



(10.44) 
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Fig. 10.12 Fuzzy output window for Example 10.2. 
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Fig. 10.13 An inverted pendulum. 

In equations (10.43) and (10.44), m is the mass and £ is the half-length of the 
pendulum and M is the mass of the trolley. F(t) is the applied force to the trolley 
in the x-direction. If it is assumed that is small and second-order terms (6 2 ) can be 
neglected, then 



F-mlQ 

M + m 



(10.45) 



P (4 _ m \ 
*- \3 M+m) 



(10.46) 
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If the state variables are 

xi = 0, x 2 = 0, xt, = x and X4 = x 
and the control variable is 

u = F(t) 

then from equations (10.45) and (10.46), the state equations become 



(10.47) 



~X\~ 




x 2 





x 3 




X4 








1 0] 




~X\~ 




"0" 


a 2 \ 







x 2 


+ 


b 2 





1 




x } 





a 4i 







X4 




[b 4 \ 



where 



a 2 \ 

a 4 i 

b 2 



3g(M + m) 
£{4(M + m) - 3m} 

— 3gm 
4(M + m) - 3m 

-3 
£{4(M + m) - 3m} 

1 



(10.48) 



\M + mj { 



3m 



(10.49) 



K M + m) \ 4(M + m) — 3m 
and the output equation is 

y = Cx 

where C is the identity matrix. For a regulator, with a scalar control variable 

u = — Kx 



The elements of K can be obtained by selecting a set of desired closed-loop poles as 
described in section 8.4.2, and applying one of the three techniques discussed. 
Data for simulation 



£=lm M=lkg m = 0.5k 
3x9.81(1.5) 



a 2 \ 



®4\ 



b 2 = 



l{(4x 1.5) -1.5} 

-3 x9.81 x0.5_ 
(4x 1.5)- 1.5 " 

-3 
l{(4x 1.5)- 1.5} 



= 9.81 

-3.27 
= -0.667 



1.5 



1.5 
(4x 1.5)- 1 



1} 



0.889 
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If the required closed-loop poles are 
s = — 2 ± j2 for the pendulum, and 
s = — 4 ± j4 for the trolley, then the closed-loop characteristic equation is 



12^ + 72^ + 192^ + 256 = 



(10.50) 



Using Ackermann's Formula in equations (8.103) and (8.104), the state feedback 
matrix becomes 



K 



174.83 



-57.12 



-39.14 



-29.36] 



(10.51) 



Using the fuzzy logic approach suggested by Johnson and Picton (1995), four, 
three set input windows (one for each state variable) and one, three set output 
window has been selected as shown in Figure 10.14. Using heuristic knowledge from 
broom-balancing experiments, the following Mamdani-type rulebase was con- 
structed: 



1. 

2. 
3. 
4. 
5. 
6. 
7. 



10. 
11. 



IF 
IF 
IF 
IF 
IF 

if 
if 
if 

IF 
IF 
IF 



s PB and is PB then F is PB 
s PB and is Z then F is PB 
s PB and is NB then F is Z 
s Z and is PB then F is PB 
s Z and is Z then F is Z 
s Z and is NB then F is NB 
s NB and is PB then F is Z 
s NB and is Z then F is NB 
s NB and is NB then F is NB 
s PB then F is PB 
s NB then F is NB 



(10.52) 



The rulebase can be extended up to 22 rules by a further set of 1 1 rules replacing 

with x and 6 with x. 

For the rulebase given in equation (10.52), the fuzzy max-min inference process is 

/iPB(w) = max[/i PB (0) 5 min(/i PB (0) 5 MpbO?)), min(/i PB (0) 5 Mz(0)), min(/i Z (0), Mpb(0))] 
Mnb(w) = max[/i NB (0), min(/i Z (0), Mnb(0)), min(/i NB (0) 5 /iz(0)), min(/i NB (0) 5 /xnb(0))] 
fi z (u) = max[min(/i PB (0) 5 // N b(0)), min(// z (0), /i Z (0))> min(/i NB (0) 5 /ip B (0))] 

Again, a similar inference process occurs with x and x. Following defuzzification, 
a crisp control force F(0 is obtained. 

Figure 10.15 shows the time response of the inverted pendulum state variables 
from an initial condition of = 0.1 radians. On each graph, three control strategies 
are shown, the 11 set rulebase of equation (10.52), the 22 set rulebase that includes 
x and x, and the state feedback method given by equation (10.51). 

For the pendulum angle, shown in Figure 10.15(a), the 11 set rulebase gives the 
best results, the state feedback being oscillatory and the 22 set rulebase diverging 
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-1.0 1.0 x 



-1.0 1.0 x 




-100 100 F 

Fig. 10.14 Input and output fuzzy windows for the inverted pendulum problem. 



after a while. The same comments apply to the pendulum angular rate, given in 
Figure 10.15(b). 

With the trolley displacement and velocity shown in Figures 10.15(c) and (d), the 
state feedback, although oscillatory, give the best results since there is no steady-state 
error. The positional error for both rulebases increases with time, and there is a 
constant velocity steady-state error for the 1 1 set rulebase, and increasing error for 
the 22 set rulebase. Figure 10.15(e) shows the control force for each of the three 
strategies. 

The 11 and 22 set rulebase simulations were undertaken using SIMULINK, 
together with the fuzzy logic toolbox for use with MATLAB. More details on the 
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(Fig. 10.15 continued) 
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Fig. 10.1 5 Inverted pendulum state variable time response for three control strategies. 



MATLAB Fuzzy Inference System (FIS) editor can be found in Appendix 1 . Figure 
10.16 shows the control surface for the 11 set rulebase fuzzy logic controller. 



10.2.5 Self-organizing fuzzy logic control 



Self-Organizing Fuzzy Logic Control (SOFLC) is an optimization strategy to create 
and modify the control rulebase for a FLC as a result of observed system 
performance. The SOFLC is particularly useful when the plant is subject to time- 
varying parameter changes and unknown disturbances. 

Structure 

A SOFLC is a two-level hierarchical control system that is comprised of: 

(a) a learning element at the top level 

(b) a FLC at the bottom level. 

The learning element consists of a Performance Index (PI) table combined with a rule 
generation and modification algorithm, which creates new rules, or modifies existing 
ones. The structure of a SOFLC is shown in Figure 10.17. With SOFLC it is usual to 
express the PI table and rulebase in numerical, rather than linguistic format. So, for 
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Fig. 10.16 Control surface for 11 set rulebase fuzzy logic controller. 
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Fig. 10.17 Self-Organizing Fuzzy Logic Control system. 
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Fig. 10.18 Tabular structure of a numerical fuzzy rulebase. 



example, the fuzzy rulebase in Figure 10.9, might take the form as shown in Figure 
10.18. 

Rulebase modification 

If the numerical structure of the fuzzy rulebase does not give an acceptable response, 
then the values in certain cells will need to be adjusted. 

Let the error, rate of change of error and control signal at time t be e(t), ce(t) and 
u{t) respectively, and assume that a given PI is a function of e(i) and ce(t). 

If there are unacceptable errors at time t, because of the dynamics of the plant, 
these will be as a result of control action taken d seconds previously, or at time 
(t — d). The parameter d is a 'delay in reward' parameter and is related to the settling 
time of the plant, having a typical value of between 3T and 5T, where T is the 
dominant time constant of the plant. 

The value of the PI is therefore determined using e(t — d) and ce(t — d) and applied 
to u(t) as a correction factor to the rulebase in the form 



IF e(t) is . . . and ce(t) is . . . THEN u(t) 



PI 



(10.53) 



where the PI is read from a Performance Index table of the form shown in Figure 
10.19. When the values of e(t — d) and ce(t — d) are within an acceptable range, the 
PI tends to zero and the fuzzy rulebase settles down and convergence for the self- 
organizing process has been achieved. The PI table is usually designed heuristically, 
based upon an intuitive understanding of the learning process, and the trade-off 
between speed of learning and stability of the rulebase. 
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Fig. 10.19 Performance Index table. 



10.3 Neural network control systems 
10.3.1 Artificial neural networks 

The human brain is comprised of many millions of interconnected units, known 
individually as biological neurons. Each neuron consists of a cell to which is attached 
several dendrites (inputs) and a single axon (output). The axon connects to many 
other neurons via connection points called synapses. A synapse produces a chemical 
reaction in response to an input. The biological neuron 'fires' if the sum of the 
synaptic reactions is sufficiently large. The brain is a complex network of sensory 
and motor neurons that provide a human being with the capacity to remember, 
think, learn and reason. 

Artificial Neural Networks (ANNs) attempt to emulate their biological counter- 
parts. McCulloch and Pitts (1943) proposed a simple model of a neuron, and Hebb 
(1949) described a technique which became known as 'Hebbian' learning. Rosenblatt 
(1961), devised a single layer of neurons, called a Perceptron, that was used for 
optical pattern recognition. 

One of the first applications of this technology for control purposes was by 
Widrow and Smith (1964). They developed an ADaptive LINear Element 
(ADLINE) that was taught to stabilize and control an inverted pendulum. Kohonen 
(1988) and Anderson (1972) investigated similar areas, looking into 'associative' 
and 'interactive' memory, and also 'competitive learning'. The back propagation 
training algorithm was investigated by Werbos (1974) and further developed by 
Rumelhart (1986) and others, leading to the concept of the Multi-Layer Perceptron 
(MLP). 
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Artificial Neural Networks have the following potential advantages for intelligent 
control: 

• They learn from experience rather than by programming. 

• They have the ability to generalize from given training data to unseen data. 

• They are fast, and can be implemented in real-time. 

• They fail 'gracefully' rather than 'catastrophically'. 



10.3.2 Operation of a single artificial neuron 



The basic model of a single artificial neuron consists of a weighted summer and an 
activation (or transfer) function as shown in Figure 10.20. Figure 10.20 shows a 
neuron in the yth layer, where 

x\ . . . xi are inputs 

Wj\ ... Wjj are weights 

bj is a bias 

fj is the activation function 

yj is the output 

The weighted sum sj is therefore 



ty(0 = Yl w fi x iW + b J 



(10.54) 



i=\ 



Equation (10.54) can be written in matrix form 

Sj(t) = W/ X + bj 



(10.55) 



The activation function/^) (where s is the weighted sum) can take many forms, some 
of which are shown in Figure 10.21. From Figure 10.21 it can be seen that the bias bj 
in equations (10.54) and (10.55) will move the curve along the s axis, i.e. effectively 



Synaptic 
Connections 



Weighted 
Summer 



Activation 
function 




Fig. 10.20 Basic model of a single artificial neuron. 
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setting the threshold at which the neuron Tires'. So in the case of the hard-limiting 
function, if bj = 0, the neuron will Tire' when Sj(f) changes from negative to positive. 
The sigmoid activation function is popular for neural network applications since it 
is differentiate and monotonic, both of which are a requirement for the back- 
propagation algorithm. The equation for a sigmoid function is 



m 



i 



(10.56) 



10.3.3 Network architecture 



Feedforward networks 

An ANN is a network of single neurons jointed together by synaptic connections. 
Figure 10.22 shows a three-layer feedforward neural network. 

The feedforward network shown in Figure 10.22 consists of a three neuron input 
layer, a two neuron output layer and a four neuron intermediate layer, called a 
hidden layer. Note that all neurons in a particular layer are fully connected to all 
neurons in the subsequent layer. This is generally called a fully connected multilayer 
network, and there is no restriction on the number of neurons in each layer, and no 
restriction on the number of hidden layers. 



As) 



1.0 




(a) Hard-Limiting (Unit Step) 



(b) Linear (Ramp) 



f(s) 



f(s) 



1.0 




1.0 



(c) Hyperbolic Tangent 
Fig. 10.21 Activation functions. 



(d) Sigmoid 
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Hidden Output 

layer layer 

Fig. 10.22 Three-layer feedforward neural network. 

Feedback (recurrent) networks 

Recurrent networks are based on the work of Hopfield and contain feedback paths. 
Figure 10.23 shows a single-layer fully-connected recurrent network with a delay 
(z _1 ) in the feedback path. 

If, in Figure 10.23, the inputs occur at time (kT) and the outputs are predicted at 
time (k+ l)T, then the network can be represented in matrix form by 

y(k + \)T = WiyQcT) + W 2 x(kT) (10.57) 

Equation (10.57) is in the same form as the discrete-time solution of the state 
equation (8.76). 



10.3.4 Learning in neural networks 



Learning in the context of a neural network is the process of adjusting the weights 
and biases in such a manner that for given inputs, the correct responses, or outputs 
are achieved. Learning algorithms include: 

(a) Supervised learning: The network is presented with training data that represents 
the range of input possibilities, together with the associated desired outputs. The 
weights are adjusted until the error between the actual and desired outputs meets 
some given minimum value. 

(b) Unsupervised learning: Also called open-loop adaption because the technique 
does not use feedback information to update the network's parameters. Applica- 
tions for unsupervised learning include speech recognition and image compres- 
sion. Important unsupervised networks include the Kohonen Self-Organizing 
Map (KSOM) which is a competitive network, and the Grossberg Adaptive 
Resonance Theory (ART), which can be used for on-line learning. 
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Fig. 10.23 Recurrent neural network. 



10.3.5 Back-Propagation 



The Back-Propagation Algorithm (BPA) is a supervised learning method for training 
ANNs, and is one of the most common forms of training techniques. It uses a 
gradient-descent optimization method, also referred to as the delta rule when applied 
to feedforward networks. A feedforward network that has employed the delta rule 
for training, is called a Multi-Layer Perceptron (MLP). 

If the performance index or cost function J takes the form of a summed squared 
error function, then 



i M 



(10.58) 



'7=1 



where dj and y t are the desired and actual network outputs respectively. Using 
gradient-descent, the weight increment Awjt is proportional to the (negative) slope 



Awji = -ii- — 
own 



(10.59) 



where // is a constant. From equations (10.58) and (10.59), 



d Wj r Mj^dw fi Kj yj) 
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using the chain rule, 



giving 



dwjt M^dyj J Vj) dwjt 



M 



dwjt M ^ J JJ dwjt 

If the activation function is the sigmoid function given in equation (10.56), then its 
derivative is 

Of e" J >- 1 / 1 x 2 



dsj (1 + Q- S jf 1 + e"^ V 1 + e " 
or 

f s =f(s)-f(s) 2 (10.61) 

Since f(s) is the neuron output j/, then equation (10.61) can be written as 

?ZL = yj(l-yj) (10.62) 

From equation (10.60), again using the chain rule, 

(10.63) 



dyj _ dyj dsj 



dwjt dsj dwjt 

If, in equation (10.54), the bias bj is called w/o, then equation (10.54) may be 
written as 



N 
Si 

i=0 



Sj = y^ WjjXj (10.64) 

thus 



dSj 8 J^ ^dWji ,+ r.sr^ 



Substituting equations (10.62) and (10.65) into (10.63) gives 

dy t 



yj(\-yj)xi (10.66) 
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Putting equation (10.66) into (10.60) gives 



dJ 

dwji 



M 



M 



J2( d j-yj)yj( l -yj) x i 



7=1 



(10.67) 



or 



dJ 

dwn 



M 



M 
7=1 



jX\ 



where 

Sj = (dj - yj)yj(l - yj) 
Substituting equation (10.68) into (10.59) gives 

M 

Awji = r)J2 6 J x i 

7=1 



where 



V 



2fi 
M 



(10.68) 



(10.69) 



(10.70) 



This leads to a weight increment, called the delta rule, for a particular neuron 

Awji(kT) = rjSjXi (10.71) 

where rj is the learning rate and has a value of between and 1. Hence the new weight 
becomes 

wjiikT) = wjiik - \)T + Awji(kT) 
or 



WjiikT) = Wjiik - \)T + rjSjXt 



(10.72) 



Consider a three layer network. Let the input layer be layer one (£ = 1), the hidden 
layer be layer two (£ = 2) and the output layer be layer three (£ = 3). The back- 
propagation commences with layer three where dj is known and hence 6j can be 
calculated using equation (10.69), and the weights adjusted using equation (10.71). 
To adjust the weights on the hidden layer (£ = 2) equation (10.69) is replaced by 



"JU 



W-yj)] t 



.7=1 



(10.73) 



£+i 
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Hence the 6 values for layer £ are calculated using the neuron outputs from layer £ 
(hidden layer) together with the summation of w and 6 products from layer £+\ 
(output layer). The back-propagation process continues until all weights have been 
adjusted. Then, using a new set of inputs, information is fed forward through the 
network (using the new weights) and errors at the output layer computed. The 
process continues until 

(i) the performance index J reaches an acceptable low value 
(ii) a maximum iteration count (number of epochs) has been exceeded 
(iii) a training-time period has been exceeded. 

For either (ii) or (iii), it may well be that a local minima has been located. Under these 
conditions the BPA may be re-started, and if again unsuccessful, a new training set 
may be required. 

The equations that govern the BPA can be summarized as 

Single neuron summation 

N 

(10.74) 



(10.75) 

(10.76) 
(10.77) 
(10.78) 
(10.79) 

(10.80) 



Learning with momentum 

When momentum is used in the BPA, the solution stands less chance of becoming 
trapped in local minima. It can be included by making the current change in weight 
equal to a proportion of the previous weight change summed with the weight change 
calculated using the delta rule. 





N 
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i + bj 
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y] ~ 1 + e~ s J 
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The delta rule given in equation (10.76) can be modified to include momentum as 
indicated in equation (10.81). 

Awji(kT) = (1 - a)rj6jXi + aAw fi (k - \)T (10.81) 

where a is the momentum coefficient, and has a value of between and 1 . 



Example 10.4 

The neural network shown in Figure 10.24 is in the process of being trained using a 
BPA. The current inputs x\ and X2 have values of 0.2 and 0.6 respectively, and the 
desired output d } ■ = 1 . The existing weights and biases are 
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Fig. 10.24 Training using back-propagation. 
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Output layer 

W/ = [3.0 2.0 1.0] by = [-4.0] 

Calculate the output j 7 and hence the new values for the weights and biases. Assume 
a learning rate of 0.5. 

Solution 

Forward propagation 

Hidden layer (I = 1): Single neuron summation 



or 



7 = 


- 1: 


S\ = W10 + WnXi + W12X2 


j = 2: s 2 = W20 + W2i-*i + W22X2 


j = 3: s 3 = w 30 + W31X1 + w 32 x 2 


s\~ 




W\\ W\2 


r -. 


"wio 


si 
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W21 W22 




^1 

_ X 2_ 
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S3 




VV31 W32 






W30 



Sigmoid activation functions (7 = 1 to 3) 

1 1 



1 



y\ 



1 + e~ J i 



y 2 



1 



J3 



1 + e-^ 



Output layer (£ = 2) 



7=1: s\ = wio + wnji + W12J2 + W13J3 



# = y\ 



1 



1 + e-^i 
Inserting values into equations (10.82) and (10.83) 
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Inserting values into equations (10.84) and (10.85) 

si = 1.031 yj=yi =0.737 
Back propagation 



Output layer 1 
Since 7 = 1 



2): From equation (10.69) 

Sj = yj(l - yjXdj - yj) 

61 = 0.737(1 - 0.737)(1 - 0.737) 
= 0.051 



(10.82) 

(10.83) 

(10.84) 
(10.85) 



(10.86) 



(10.87) 
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Delta rule 



Awjt(kT) = rjSjXj 

Awio = 0.5 x 0.051 x 1 = 0.0255 
Awn = 0.5 x 0.051 x 0.891 = 0.0227 
Awn = 0.5 x 0.051 x 0.69 = 0.0176 
Awn = 0.5 x 0.051 x 0.978 = 0.0249 

New weights and biases for output layer 

w 7 = [3.0227 2.0176 1.0249] by = [-3.975] 

Hidden layer (£ = 1): From equation (10.80) 



(10.88) 



"JU 



W-yj)] t 



Y. w J i6 J 



.7=1 



M 



To illustrate this equation, had there been two neurons in layer (£ + 1), i.e. the output 
layer, then values for 6\ and 62 for layer (£ + 1) would have been calculated. Thus, for 
layer £ (the hidden layer), the [Sj] £ values would be 



7=1: [S l ] e = \y l (l- 


-^OM^ii^i +w 2 i6 2 ] e+] 


7 = 2: [6 2 ] e = \y 2 (l- 


-yiflelmiSi +w 22 8 2 ] M 


7 = 3: [63^ = I>3(1 - 


-yiMmrfi +w 2i 6 2 ] i+l 



However, since in this example there is only a single neuron in layer 1 
Thus the 6 values for layer £ are 



J= 1 
7 = 2 
7 = 3 



[Si] e = [0.891(1 - 0.891)][3.0227 x 0.051] = 0.015 
[S 2 ] e = [0.690(1 - 0.690)][2.0176 x 0.051] = 0.022 
[6 3 ] e = [0.978(1 - 0.978)][1.0249 x 0.051] = 0.001 



!+l),«2 = 0. 



(10.89) 



Hence, using the delta rule, the weight increments for the hidden layer are 

Awio = 0.5 x 0.015 x 1 =0.0075 
Awn = 0.5 x 0.015 x 0.2 = 0.0015 
Aw l2 = 0.5 x 0.015 x 0.6 = 0.0045 
Aw 20 = 0.5 x 0.022 x 1 = 0.0110 
Aw 2 i = 0.5 x 0.022 x 0.2 = 0.0022 
Aw 22 = 0.5 x 0.022 x 0.6 = 0.0066 
Aw 30 = 0.5 x 0.001 x 1 = 0.0005 
Aw 3 i = 0.5 x 0.001 x 0.2 = 0.0001 
Aw 32 = 0.5 x 0.001 x 0.6 = 0.0003 
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The new weights and biases for the hidden layer now become 



W 7 



1.0015 
0.5022 
2.5001 



1.5045" 




"1.0075" 


2.0066 


b,= 


-0.489 


3.0003 




1.5005 



(10.90) 



10.3.6 Application of neural networks to modelling, estimation 
and control 



An interesting and important feature of a neural network trained using back-propa- 
gation is that no knowledge of the process it is being trained to emulate is required. 
Also, since they learn from experience rather than programming, their use may be 
considered to be a 'black box' approach. 

Neural networks in modelling and estimation 

Providing input/output data is available, a neural network may be used to model the 
dynamics of an unknown plant. There is no constraint as to whether the plant is 
linear or nonlinear, providing that the training data covers the whole envelope of 
plant operation. 

Consider the neural network state observer shown in Figure 10.25. This is similar 
in operation to the Luenberge full-order state observer given in Figure 8.9. If the 
neural network in Figure 10.25 is trained using back-propagation, the algorithm will 
minimize the PI 



J = J2 (j(kT) - y(kT)) T (y(kT) - y(kT)) 



(10.91) 



k=\ 



Richter et al. (1997) used this technique to model the dynamic characteristics 
of a ship. The vessel was based on the Mariner Hull and had a length of 161m 
and a displacement of 17 000 tonnes. The training data was provided by a three 
degree-of-freedom (forward velocity, or surge, lateral velocity, or sway and turn, or 



u(kT) 




> x{kT) 



Fig. 10.25 Neural network state observer. 
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yaw-rate) differential equation model produced by Burns and was based on previous 
work by Morse and Price. 

The training file consisted of input data of the form: Time elapsed t(kT), Rudder 
angle S(kT), Engine speed n(kT) with corresponding output data Forward velocity 
u(kT), Lateral velocity v(kT), Yaw-rate r(kT). 

With the engine speed held constant, the rudder was given step changes of 0°, 
±10°, ±20° and ±30°. Figure 10.26 shows training and trained data for a rudder 
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Fig. 10.26 Training and trained data for a neural network model of a Ship's Hull. 

angle of +20° (where positive is to port, or left). The input and output data was 
sampled every 5 seconds, during the transient period of the turn (0-300 seconds). 

The selected network had a 3-6-6-6-3 structure, i.e. input and output layers 
comprising 3 neurons in each, separated by three hidden layers of 6 neurons. During 
learning, 4 million epochs were trained. The learning rate and momentum were 
initially set at 0.3 and 0.8, but were reduced in three steps to final values of 0.05 
and 0.4 respectively. 

Inverse models 

The inverse model of a plant provides a control vector u(kT) for a given output 
vector y(kT) as shown in Figure 10.27. 



u(kT) 




Fig. 10.27 Neural network plant inverse model. 
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r(kT) + e(kT) 
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Existing 
=» Controller 
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Error 
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Controller 



Switch 



Plant 



Unn(kT) 



V(kT) 
=> 



Fig. 10.28 Training a neural network controller. 

So, for example, with the ship model shown in Figure 10.26, the inverse model could 
be trained with time, forward velocity, lateral velocity and yaw-rate as input data and 
rudder angle and engine speed as output data. 

Neural networks in control 

Controller emulation: A simple application in control is the use of neural networks to 
emulate the operation of existing controllers. It may be that a nonlinear plant 
requires several tuned PID controllers to operate over the full range of control 
actions. Or again, an LQ optimal controller has difficulty in running in real-time. 
Figure 10.28 shows how the control signal from an existing controller may be used to 
train, and to finally be replaced by, a neural network controller. 

Error back-propagation through plant model 

All closed-loop control systems operate by measuring the error between desired 
inputs and actual outputs. This does not, in itself, generate control action errors that 
may be back-propagated to train a neural network controller. If, however, a neural 
network of the plant exists, back-propagation through this network of the system 
error (r(kT) — y(kT)) will provide the necessary control action errors to train the 
neural network controller as shown in Figure 10.29. 

Internal Model Control (IMC) 

Internal Model Control was discussed in relation to robust control in section 9.6.3 
and Figure 9.19. The IMC structure is also applicable to neural network control. The 
plant model G m (s) in Figure 9.19 is replaced by a neural network model and the 
controller C(s) by an inverse neural network plant model as shown in Figure 10.30. 



10.3.7 Neurofuzzy control 



Neurofuzzy control combines the mapping and learning ability of an artificial neural 
network with the linguistic and fuzzy inference advantages of fuzzy logic. Thus 
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Fig. 10.29 Control action error generated by system error back-propagation through plant model. 
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=> 



Plant 
Model 




Fig. 10.30 Application of neural networks to IMC. 

a neurofuzzy controller has the potential to out-perform conventional ANN or fuzzy 
logic controllers. The general architecture of a neurofuzzy scheme is to employ neural 
network learning to upgrade either the membership functions or rulebase of the fuzzy 
logic element. 

The Adaptive Network based Fuzzy Inference System (ANFIS) 

The ANFIS neurofuzzy controller was implemented by Jang (1993) and employs 
a Takagi-Sugeno-Kang (TSK) fuzzy inference system. The basic ANFIS architecture 
is shown in Figure 10.31. 

Square nodes in the ANFIS structure denote parameter sets of the membership 
functions of the TSK fuzzy system. Circular nodes are static/non-modifiable and 
perform operations such as product or max/min calculations. A hybrid learning rule 
is used to accelerate parameter adaption. This uses sequential least squares in the 
forward pass to identify consequent parameters, and back-propagation in the back- 
ward pass to establish the premise parameters. 
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Layer 1 Layer 2 

(Premise Parameters) 



Layer 3 Layer 4 Layer 5 

(Consequent Parameters) 



Xi x 2 




X, x 2 



Fig. 10.31 The Adaptive Network based Fuzzy Inference System (ANFIS) architecture (after Craven). 



If the fuzzy inference system has inputs x\ and X2 and output /as shown in Figure 
10.31, then a first-order TSK rulebase might be 



Rule 1 : 
Rule 2: 
Rule n : 



If x\ is A\ and x 2 is B\ 
then/i = p\X\ +q\X2 +r\ 
If x\ is A2 and X2 is B2 
then f 2 = P2X1 + q2*2 + r 2 
If jci is A n and x 2 is B n 
then /„ = p n x x + ^x 2 + r w 



(10.92) 



Where A\ .. ,A n , B\ .. .B n are membership functions and /?i .../>„, ^1 ...q n and 
r\...r n are constants within the consequent functions. 

Layer 1 contains adaptive nodes that require suitable premise membership func- 
tions (triangular, trapezoidal, bell, etc). Hence 



y\,t = m( x d 

Layer 2 undertakes a product or T-norm operation. 

yi,i = wt = fJ> Ai (xi)fjLBi(x2) • • • t*pi(x n ) i=l,2...,n 
Layer 3 calculates the ratio of the firing strength of the rules 



J3, ( 



ELi^ 



(10.93) 



(10.94) 



(10.95) 
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Layer 4 generates the linear consequent functions as given in equation (10.92). Layer 
5 sums all incoming signals 



ys,i 



n \-^n r 



(10.96) 



A limitation of the ANFIS technique is that it cannot be employed on multivariable 
systems. The Co-active ANFIS (CANFIS) developed by Craven (1999) extends the 
ANFIS architecture to provide a flexible multivariable control environment. This 
was employed to control the yaw and roll channels of an Autonomous Underwater 
Vehicle (AUV) simultaneously. 

Predictive Self-Organizing Fuzzy Logic Control (PSOFLC) 

This is an extension of the SOFLC strategy discussed in section 10.2.5 and illustrated 
in Figure 10.17. Predictive Self-Organizing Fuzzy Logic Control is particularly useful 
when the plant dynamics are time-varying, and the general architecture is shown in 
Figure 10.32. 

In Figure 10.30 the predictive neural network model tracks the changing dynamics 
of the plant. Following a suitable time delay, e m (kT) is passed to the performance 
index table. If this indicates poor performance as a result of changed plant dynamics, 
the rulebase is adjusted accordingly. Richter (2000) demonstrated that this technique 
could improve and stabilize a SOFLC when applied to the autopilot of a small 
motorized surface vessel. 
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Fig. 10.32 Predictive Self-Organizing Fuzzy Logic Control (PSOFLC). 
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Genetic algorithms and their application to control 
system design 



10.4.1 Evolutionary design techniques 




In any design problem there is a multi-dimensional space of possible solutions. Some 
of these solutions may be acceptable, but not the best (local optima) and there may 
exist a single best solution (global optimum). 

It has been shown in Chapter 9 that it is possible to obtain an optimal mathemat- 
ical solution for a control system with linear plant dynamics. An alternative 
approach is to use 'heuristics', or knowledge acquired through experience, to search 
for optimal solutions. One such technique is to employ a Genetic Algorithm (GA). 
This is a search algorithm based upon the evolutional process of natural selection of 
the fittest members of a given population to breed the next generation. 



10.4.2 The genetic algorithm (GA) 

In the early 1960s Rechenburg (1965) conducted studies at the Technical University 
of Berlin in the use of an evolutionary strategy to minimize drag on a steel plate. 
Genetic algorithms were used by Holland (1975) and his students at the University of 
Michigan in the late 1970s and early 1980s to analyse a range of engineering 
problems. In particular, Goldberg (1983) used GAs to optimize the design of gas 
pipeline systems. 

The basic element of a GA is the chromosome. This contains the genetic inform- 
ation for a given solution and is typically coded as a binary string. For example, an 
eight digit binary number such as 11001001 represents a chromosome that contains 
eight genes. Initially, a population of chromosomes, created randomly, represent 
a number of solutions to a given problem. 

A 'fitness function', which is in effect a performance index, is used to select the best 
solutions in the population to be parents to the offsprings that will comprise the next 
generation. The fitter the parent, the greater the probability of selection. This 
emulates the evolutionary process of 'survival of the fittest'. Parents are selected 
using a roulette wheel method as shown in Figure 10.33. Here there are four 
candidate parents PI, P2, P3 and P4, having selection probabilities (from the fitness 
function) of 0.5, 0.3, 0.15 and 0.05 respectively. For the example in Figure 10.33, if 
the roulette wheel is spun four times, PI may be selected twice, P2 and P3 once, and 
P4 not at all. 

Offsprings are produced by selecting parent chromosomes for breeding, and cross- 
ing over some of the genetic material. The amount of genetic material passed from 
parent to offspring is dictated by the random selection of a crossover point as indicated 
in Figure 10.34, where PI and P2 are the parents, and 01 and 02 the offsprings. 

Mutation is allowed to occur in some of the offsprings, the amount being con- 
trolled by the mutation rate, typically a very small number. This results in the 
random change in a gene in an offspring, i.e. from to 1. 

The breeding of successive generations continues until all offsprings are acceptably 
fit. In some cases, all offsprings will eventually have the same genetic structure, 
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v Pointer 




Fig. 10.33 Roulette wheel selection. 

Crossover Point 

y 

P1 1 1 | 1 1 1 ^~~~—~^^ 1 1 ° °JJl 1 1 ° 

P2 1 1 1 | 1 1 ' 02 10 11 | 1 1 1 

Fig. 10.34 Genetic material transfer during breeding. 

representing a global optimum, or in other cases, several solutions, called clustering 
may evolve. In this latter case, the system designer makes the decision as to which is 
the best solution. 

Example 10.5 

A system has a fitness function 

/=l+sin<2;c (10.97) 

as shown in Figure 10.35. Assume that the solution space has 31 values and that each 
solution can be represented by a five digit binary string ranging from 00000 to 11111. 
The value of a in equation (10.97) is therefore 1 1.6° (0.203 rad). If the population has 
four members, spinning a coin (heads = 1, tails = 0) produced the following initial 
population 

00101 11110 00001 00011 

Determine the offsprings from the initial generation and the subsequent generation. 

Solution 

From Figure 10.35 it can be seen that the optimal solution occurs when x\o = 8, or 

x 2 = 01000. 

Table 10.1 shows the selection of parents for mating from the initial population. If 
a random number generator is used to generate numbers between 0.0 and 1.0, then 
the cumulative probability values in Table 10.1 is used as follows: 

Values between and 0.342, Parent 1 selected 
Values between 0.343 and 0.488, Parent 2 selected 
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Fig. 10.35 Fitness function for Example 10.5. 



Table 10.1 Selection of parents for mating from initial population 



Parent 


X2 


*10 


J=f(x) 


p = JIY>J 


Cumulative 
probability 


Roulette 
wheel hits 


1 

2 
3 
4 


00101 
11110 
00001 
00011 


5 

30 

1 

3 


1.848 
0.792 
1.201 
1.571 


0.342 
0.146 
0.222 
0.290 


0.342 
0.488 
0.710 
1.000 


2 
1 

1 


Total 

Mean 
Maximum 






5.412 
1.353 
1.848 


1.000 
0.250 
0.342 




4 
1 

2 



Values between 0.489 and 0.710, Parent 3 selected 
Values between 0.711 and 1.000, Parent 4 selected 

The random number generator produced the following values: 0.326, 0.412, 0.862 
and 0.067. Hence Parent 1 was selected twice, Parents 2 and 4 once and Parent 3 not 
at all. The selected parents were randomly mated with random choice of crossover 
points. The fitness of the first generation of offsprings is shown in Table 10.2. 

From Tables 10.1 and 10.2 the total fitness of the initial population was 5.412, 
whereas the total fitness of their offsprings was 5.956, an increase of 10%. Note that 
if each offspring was perfect, they would have a value of 810, or OIOOO2, thus giving 
the maximum fitness that any population could have of 2 x 4 = 8.0. 

The next spin of the random number generator produced values: 0.814, 0.236, 
0.481 and 0.712, giving the roulette wheel hits shown in Table 10.2. 

The second generation of offsprings is shown in Table 10.3. From Table 10.3 the 
total fitness of the second generation of offsprings is 7.204, or an increase of 33% 
above the initial population. As things stand, since the two most significant binary 
digits in the second generation offsprings are 00, subsequent breeding will not 
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Table 10.2 Fitness of first generation of offsprings 



Parent 


Breeding Offspring x 2 


*io J=f(x) p 


= JIE 


J Cumulative 
probability 


Roulette 
wheel hits 


1 

2 


00101 

X 

11110 


1 

2 


00110 
11101 


6 1.937 
29 0.600 


0.325 
0.101 




0.325 
0.426 


1 




1 
4 


00101 
X 
oolon 


3 
4 


00011 
00101 


3 1.571 
5 1.848 


0.264 
0.310 




0.690 
1.000 


1 

2 


Total 








5.956 


1.000 








Mean 








1.489 


0.250 








Maximum 








1.937 


0.325 












Table 10.3 


Fitness of second generation of offsprings 




) 






Parent 




Breeding 


Offspring x 2 


Xio 


/=/(* 






1 
4 




001 
001 


10 

X 

01 


1 00101 

2 00110 


5 
6 


1.848 
1.937 






3 
4 








0011 

X 

0101 


3 00101 

4 00011 


5 
3 


1.848 
1.571 








Total 










7.204 








Mean 










1.801 










Maximum 








1.937 







produce strings greater than 001 1 1, or 7io. If all four offsprings had this value, then a 
total fitness for the population would be 7.953, which is close to, but not the ideal 
fitness of 8.0 as explained earlier. However, if mutation in a particular offspring 
changed one of the two most significant digits from to 1 , a perfect optimal value 
could still be achieved. Also to bear in mind, is the very limited size of the population 
used in this example. 



Example 10.6 

The block diagram for an angular positional control system is shown in Figure 10.36. 

The system parameters are: 

Amplifier gain K2 = 3.5 

Servomotor constant K3 = 1 5 Nm/A 

Field resistance Rf = 20 Q 

Gear ratio n = 5 

Equivalent moment of inertia of motor and load I Q = 1.3 kgm 2 

Sampling time T = 0.05 seconds. 

Using a GA with a population of 10 members, find the values of the controller gain 
K\ and the tachogenerator constant K 4 that maximizes the fitness function 



iN-l 



J = 100 / J2 {(°i( kT ) - Oo(kT)) 2 T 



(10.98) 



£=0 



when the system is subjected to a unit step at time kT = 0. Perform the summation 
over a time period of 2 seconds (TV = 40). Allow a search space of 0-15 for K\ and 
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Fig. 10.36 Angular positional control system. 

0-1 for K 4 . Assume that the solution space has 255 values and that each solution 
can be represented by an eight digit binary string, the first four digits representing 
K\ and the second four representing K4. 



Solution 






The plant transfer function is 








u {s) - 


_ K 2 K 3 n 
Rfhs 2 



(10.99) 



If the state variables are x\ = 6o(t) and x 2 = #o(0 = x\, then the state equations 
become 



*2 



1 




x 2 





K 2 K 3 n 

Rfh 



and the output equations 



Inserting values into the state equations 



~0 ' 
A _ 


= 


"1 0" 
1 




X\ 



X\ 

_*2_ 


= 


r 



X\ 

_*2_ 


+ 



10.096 



(10.100) 

For a sampling time of 0.05 seconds, the discrete form of equation (10.100) is 
xi(k+l)T] \\ 0.05] \xiikT)] [0.0126] 

* 2 (fc+i)r = o i x 2 (/tr) + 0.5048 u{kT) (10101) 



From Figure 10.36 the control law is 

u(kT) = Ki(9i(kT) - x x (kT)) - nK 4 x 2 (kT) 
where { (kT) = 1.0 for all kT > 0. 



(10.102) 
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Hence values of K\ and K4 generated by the GA are inserted into equation (10.102) 
and the control u(kT) used to drive the discrete plant equation (10.101). The fitness 
function / is updated at each sampling instant to give an overall value at the end of 
each simulation. For a population of 10 members, 10 simulations are required per 
generation. 

Since the required search space is K\ 0-15, K\ 0-1, the following are examples of 
population membership 



K x 


K 4 




1111 


1111 K x 


= 15 K 4 = 1 


0011 


0111 Ki 


= 3 ^4 = 7/15 = 0.467 


1001 


1100 Ki 


= 9 ^4 = 12/15 = 0.8 



Table 10.4 shows the parent selection for mating from a randomly seeded initial 
population. The random numbers (0-1) from the roulette wheel spins were: 0.145, 
0.422, 0.977, 0.339, 0.607, 0.419, 0.075, 0.027, 0.846, 0.047. 

The fitness of the first generation of offsprings is given in Table 10.5. Further 
breeding produced the sixth generation of offsprings given in Table 10.6. Inspection of 
Table 10.6 reveals that values of K\ = 15, K 4 = 0.333 produces a global maximum of 
/ = 1065. Figure 10.37 shows the unit step response of the system in Example 10.6 for 

(a) the maximum of the first generation of offsprings (/ = 841) 

(b) the global maximum of the sixth generation of offsprings (/ = 1065) 

Use of Schemata (Similarity templates): As the progression through generations of 
solutions takes place, there evolves certain similarities between genes within chromo- 
somes. These similarities can be exploited using a similarity template or schema, that 
sits within a schemata framework. 

A schema employs a don't care symbol '*', so, for example, the sixth generation of 
offsprings in Table 10.6 could have employed the template 

111**1** 
The use of schemata will aid the speed of convergence. 

Table 10.4 Parent selection from initial population for Example 10.6 



Parent 


K x 


K 4 


J 


p = J/EJ 


Cumulative 
probability 


Roulette 
wheel hits 


1011 1001 


11 


0.600 


647 


0.157 


0.157 


4 


0100 1010 


4 


0.667 


233 


0.056 


0.213 





0001 0111 


1 


0.400 


112 


0.027 


0.240 





1001 1010 


9 


0.667 


497 


0.122 


0.362 


1 


11100111 


14 


0.467 


923 


0.224 


0.586 


2 


0101 0001 


5 


0.067 


375 


0.092 


0.678 


1 


1001 1101 


9 


0.867 


18 


0.004 


0.682 





0110 1101 


6 


0.867 


46 


0.011 


0.693 





1101 1010 


13 


0.667 


691 


0.168 


0.861 


1 


0101 0100 


5 


0.267 


573 


0.139 


1.000 


1 


Total 






4115 


1.000 




10 


Mean 






411.5 


0.100 




1 


Maximum 






923 


0.224 




4 
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Table 10.5 Fitness of first generation of offsprings for Example 10.6 



Parent 



Offspring 



Ki 



K 4 



J 



10111 1001 
m|o 0111 

oioi qooi 
oioi qioo 

101111001 

1001I1010 
noi lqio 

1011 1Q01 
10111 1001 
m|o 0111 

Total 

Mean 
Maximum 



10110 0111 
11 l|l 1001 

oioi qioo 
oioi qooi 

101111010 

1001I1001 
noi lqoi 
ion io|io 

10110 0111 

m|i looi 



10 

15 

5 

5 

11 
9 
13 
11 
10 
15 



0.467 


712 


0.600 


841 


0.267 


573 


0.067 


375 


0.667 


596 


0.600 


541 


0.600 


747 


0.667 


596 


0.467 


713 


0.600 


841 




6535 




653.5 




841 



Table 10.6 Fitness of sixth generation of offsprings for Example 10.6 



1.2 

o(t) 

1 

0.8 
0.6 
0.4 
0.2 



Offspring 



K 4 



1110 0101 


14 


0.333 


1030 


mi ono 


15 


0.400 


1029 


1110 0100 


14 


0.267 


1021 


mi oioi 


15 


0.333 


1065 


mi oin 


15 


0.467 


970 


mi oioo 


15 


0.267 


1041 


1110 1000 


14 


0.533 


858 


11100111 


14 


0.467 


923 


mi iooo 


15 


0.533 


905 


mi oioi 


15 


0.333 


1065 


Total 






9907 


Mean 






990.7 


Maximum 






1065 













^Sixt 


i gener 


ation 






































' First g 


eneratk 


)n 



































































0.1 



0.2 0.3 



0.4 



0.5 0.6 
Time (s) 



0.7 0.8 



0.9 



Fig. 10.37 Comparison between best first generation and best sixth generations solutions for Example 1 0.6. 
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Other applications of Genetic Algorithms 

(a) Optimal control: Optimal control problems such as the linear quadratic regulator 
discussed in section 9.2 can also be solved using GAs. The discrete quadratic 
performance index given in equation (9.28) can be employed as a (minimum) 
fitness function directly. Alternatively, as shown in Example 10.6 the reciprocal 
of equation (9.28) provides a (maximum) fitness function. 

(b) Self-Organizing Fuzzy Logic Control. Genetic Algorithms may be used to adapt 
both membership functions and rulebase structures in a SOFLC system. 

Figure 10.38 shows an input window with three triangular fuzzy sets NB, Z and 
PB. Each set is positioned in its regime of operation by the centre parameter c so that, 
for example, NB can only operate on the negative side of the universe of discourse. 
The width of each set is controlled by parameter w. 

The chromosome string could take the form 



[c\ w\ c 2 w 2 c 3 w 3 ] 



(10.103) 



c 2 



1.0 



























Ci 








c 3 


















► 






' NE 


3 /\ Z / 


\ PB 




W, 




w 3 










w 2 


► 




w 



Fig. 10.38 Adaption of membership function features using genetic algorithms. 

If each parameter is a 4-bit string, the configuration in Figure 10.38 would be 
represented by 

[100011111000111110001111] (10.104) 



10.4.3. Alternative search strategies 



In addition to evolutionary search strategies such as GAs, there are a number of 
other search techniques that are employed for design optimization. 
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Simulated annealing 

The physical annealing process consists of heating a metal up to a prescribed 
temperature and then allowing it to cool slowly. During cooling, the molecules form 
crystals which are in a minimum energy condition. The metal, therefore, settles to 
a global minimum energy state. 

With simulated annealing, an energy term E is defined, which then becomes the 
performance index to be minimized. For a given energy change AE at temperature T 7 , 
the probability P of accepting a solution is 

p = e -A£/kr (10.105) 

where k is the Boltzmann constant. If the energy of the system has decreased, then the 
system may move to the new state, based on the probability given by equation 
(10.105). As cooling proceeds along a prescribed schedule, the system avoids local 
minima, and settles down to a global minimum energy state. 

Tabu search 

Like simulated annealing, tabu search is a technique designed to avoid the problem 
of becoming trapped in local optima. The procedure is basically hill-climbing, which 
commences at an initial solution and searches the neighbourhood for a better solu- 
tion. However, the process will recognize, and avoid areas of the solution space that 
it has already encountered, thus making these areas 'tabu'. The tabu moves are kept 
in a finite list, which is updated as the search proceeds. 



10.5 Further problems 



Example 10.7 

A fuzzy logic controller has input and output fuzzy windows as shown in Figure 
10.39. The fuzzy rulebase is given in Figure 10.40. If defuzzification is by the centre of 
area method, calculate crisp control signals u(t) when the error e(t) and the rate of 
change of error ce(t) have the following values: 





e(t) 


ce{i) 


[Answer u(t)] 


(i) 





-2 




-6.67 


(ii) 


-4 


-1 




-2.66 


(iii) 


1 


1.5 




3.01 


(iv) 


4 


-1.5 




0.106 



Note: For the centre of area method, use only those values inside the dotted lines in 
the output window. 

Example 10.8 

The angular positional control system shown by the block diagram in Figure 10.36 is 
to have the velocity feedback loop removed and controller K\ replaced by a fuzzy 
logic controller (FLC) as demonstrated by Barrett (1992). The inputs to the FLC 
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Output Window 



Fig. 10.39 Input and output fuzzy windows for Example 10.7. 



\ e 


NB 


Z 


PB 


NB 


NB 


NB 


Z 


Z 


NB 


Z 


PB 


PB 


Z 


PB 


PB 



Fig. 10.40 Fuzzy rulebase for Example 10.7 

are angular error e(kT) and rate-of-change of angular error ceikT). The output from 
the FLC is a control signal u(kT). The input and output fuzzy windows have the 
same number of fuzzy sets, but different scales for the universes of discourse as 
shown in Figure 10.41. The fuzzy rulebase is given in Figure 10.42. If the state 
variables are 



xi = O (O 

*2 = 00(0 = Xl 
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NM NS ZE PS PM 




-2-10 1 2 

Normalized Universe of Discourse 



3 e(kT) 



-4 



8 ce(kT) 



-5 -4 -3-2-1 1 2 

Fig. 10.41 Input and output fuzzy windows for Example 10.8. 



5 u(kT) 



\ e 
ce \ 


NB 


NM 


NS 


ZE 


PS 


PM 


PB 


NB 
NM 
NS 
ZE 
PS 
PM 
PB 


NB 


NB 


NM 


NS 


ZE 


PM 


PB 


NB 


NB 


NM 


NM 


PS 


PM 


PB 


NM 


NS 


NS 


NS 


PS 


PM 


PM 


NM 


NS 


NS 


ZE 


PS 


PS 


PM 


NM 


NM 


NS 


PS 


PS 


PS 


PM 


NB 


NM 


NS 


PM 


PM 


PB 


PB 


NB 


NM 


ZE 


PS 


PM 


PB 


PB 



Fig. 10.42 Fuzzy rulebase for Example 10.8. 
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then the state and output equations for the plant are as given in equation (10.100) 



(10.106) 



and, for a sampling time of 0.2 seconds, the discrete form of equation (10.106) is 

u(kT) (10.107) 



_X 2 _ 


= 


"o r 




x\ 

_X 2 _ 


+ 



10.096 


'Ox 




"l o" 


X\ 




A 




1 


_X 2 _ 







= 


"1 0.2" 
1 


m xi(kT)' 

x 2 (kT) 


+ 


"0.2019" 
2.0192 



x x (k+\)T 
x 2 (k+l)T 



If the system, which is initially at rest when kT = 0, is given a unit step input at this 
time, determine e(kT), ce(kT), u(kT), x\(kT) and x 2 (kT) for values of kT = 0, 
0.2, 0.4 and 0.6 seconds. 
Assume that 

e(kT) = (8 i -8 )=l-x l (kT) 

ce(kT) = d/dt(0i - ) 

_ d0i d<9 
^ d^ dt 

d^o 



0- 



dt 



-x 2 (kT) 



Solution 



Table 10.7 Solution to 


Example 10.8 










kT x x (kT) x 2 (kT) 


e(kT) 


ce(kT) 


u(kT) 


xi(k+l)T 


x 2 (k+\)T 




0.2 0.2187 2.187 
0.4 0.7906 3.532 
0.6 1.2305 0.867 


1 

0.7813 

0.2094 

-0.2305 




-2.187 
-3.532 
-0.867 


1.083 
0.666 
-1.32 
-0.511 


0.2187 
0.7906 
1.2305 
1.3007 


2.187 

3.532 

0.867 

-0.165 



Example 10.9 

A neural network has a structure as shown in Figure 10.43. Assuming that all 
the activation functions are sigmoids, calculate the values of y\ 2 and y 22 when the 
inputs are 



(a) x\ 

(b) X! 



0.3, x 2 
0.9, x 2 



0.5 
0.1 



when the weights and biases are 
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.K12 Y22 



Output layer 
{1 = 2) 



Hidden layer 



Input layer 




Fig. 10.43 Neural network structure for Example 10.9. 
Hidden layer 



Output layer 



W,i = 



w 



p- 



1 2 
3 3 

2 1 



b/i = 



-3 -2 1 
1 2 3 



2 

-2 
1 



Solution 

(a) J12 = 0.450, J22 = 0.862 

(b) y u = 0.405, y 22 = 0.906 

Example 10.10 

In Example 10.9(b), if the target values for the outputs are d\ 2 = and d 22 = 1, 
calculate new values for the weights and biases using the back-propagation algo- 
rithm. Assume a learning rate of 0.5 with no momentum term. 
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-0.098, S 2 



Solution 
Output layer: 6\ 



W /: 



-3.047 
1.004 



0.008 (Equation 10.78) 

b j2 = 



-2.036 0.954 
2.003 3.004 



2.951 
-2.996 



Hidden layer: S x = 0.0016, 6 2 = 0.042, 6 3 



-0.003 (Equation 10.80) 



W 



n 



1.0007 


2.00008 




2.0008 


3.019 


3.0021 


b,,= 


-1.979 


1.999 


0.9999 




0.9985 



Example 10.11 

A system has a parabolic fitness function 



/ = 



■ 2x 



(10.108) 



Using a genetic algorithm, find the value of x that maximizes / in equation (10.108). 
Assume that the solution space has 3 1 values in the range x = to 2 and that each 
solution can be represented by a five digit binary string ranging from 00000 to 11111. 
Let the population have four members and it is initially seeded by spinning a coin 
(heads = 1, tails = 0). 

Solution 



x(2) 


01110 


01111 


10000 


10001 


x(10) 


14 


15 


16 


17 


X 


0.903 


0.968 


1.032 


1.097 


J 


0.990591 


0.998976 


0.998976 


0.990591 



Hence x = 0.968 and 1.032 both give optimum solutions. 

Example 10.12 

The closed-loop control system analysed by the root-locus method in Example 5.8 
can be represented by the block diagram shown in Figure 10.44. Using root-locus, the 
best setting for K\ was found to be 11.35, representing a damping ratio of 0.5. 



Proportional 
Controller 



Plant 




Fig. 10.44 Block diagram for Example 5.8. 
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Validate, or otherwise, using a genetic algorithm that this value of K\ maximizes 
the fitness function 



iN-\ 



/ = ioo/^{(r(^r)-^r)) 2 r} 



(10.109) 



£=0 



when the system is subjected to a unit step at time kT = 0. Using a sampling time 
T = 0.05 seconds, perform the summation over a time period of 10 seconds 
(N = 200). Allow a search space of 0-100 for K\. Assume that the solution space 
has 255 values and that each solution can be represented by an eight digit binary 
string chromosome. Use a randomly seeded initial population of 10 members. 
If the state variables are 

xi = c(i) 

X 2 = c(i) = X\ 

x 3 = c(t) = x 2 

From Figure 10.44, the plant differential equation may be written as 

X3 = Oxi — 10x2 — 7x3 + u 
The plant state and output equations are then 

Xi 

x 2 
x 3 _ 

C = [l 0]x (10.110) 

For a sampling time of 0.05 seconds, the discrete form of equation (10.110) is 






1 


" 




~X\~ 




"0" 








1 




x 2 


+ 








-10 


-1 _ 




_ X 3. 




1 



xi(k+l)T 




1.0 


0.0498 


0.0011 




x x {kT) 




0.00002 




x 2 (k+l)T 


= 


0.0 


0.9889 


0.0420 




x 2 (kT) 


+ 


0.00111 


u(kT) 


x 3 (k+l)T_ 




0.0 


-0.4201 


0.6948 _ 




_x 3 (kT)_ 




_ 0.04201 


(10.111) 



Solution 



Ki(2) 


00011101 


00101001 


00110011 


00111000 


10000001 


10110011 


J 


29 

11.37 
112.99 


41 

16.08 
124.51 


51 

20.0 
126.63 


56 
21.96 

125.82 


129 
50.59 
48.18 


179 
70.20 

7.77 



Thus the value of K\ that maximizes the fitness function in equation (10.109) is 
K\ = 20.0. This produces an overshoot of 38% when kT = 2.0 seconds, and repre- 
sents an u n of 1.847 rad/s and a ( of 0.303. 



//SYS21 /D:/B&H3B2/ACE/REVISES(08-08-01 )/ACED01 .3D - 380 - [380-423/44] 9.8.2001 2:43PM 



Appendix 1 

Control system design 

using MATLAB 



A1.1 Introduction 

MATLAB, its Toolboxes and SIMULINK have become, over a number of years, the 
industry standard software package for control system design. The purpose of this 
Appendix is to introduce the reader to some of the more useful aspects of MATLAB, 
and to illustrate how the software may be used to solve examples given in the main 
text of the book. 



A1.1.1 Getting started 



The examples given in this Appendix were generated using MATLAB Version 5.3. 
Once the software has been installed, MATLAB is most easily entered by clicking the 
MATLAB icon. Alternatively, in a Windows environment, MATLAB can be entered 
by clicking the following sequence 

Start — ► Programs — ► MATLAB for Windows — ► MATLAB 5.3 

The user should now be in the MATLAB command window, which contains some 
helpful comments together with the MATLAB prompt » . MATLAB commands are 
typed after the prompt, and entered using 'Return' (or 'Enter'). Terminating the 
command with ';' will suppress the result of the command being printed in the 
command window. Comments are preceded by the '%' symbol. 



A1.2 Tutorial 1: Matrix operations 

This tutorial introduces the reader to matrix operations using MATLAB. All text in 
courier font is either typed into, or printed into the command window. 

»% Matrix Operations 
»% To enter a matrix 
»A=[1 3;5 9] ; 
»B=[4 -7; 10 0] ; 
»A 
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A= 





1 


3 




5 


9 


»B 






B = 








4 


-7 




10 






»% Note that MATLAB is case sensitive 

»% Matrix Addition 

»A+B % Terminating with ' ; ' will suppress ' ans ' 

ans = 

5 -4 
15 9 
»% Matrix Multiplication 
»A*B 
ans = 

34 -7 
110 -35 
»% Determinant of a Matrix 
»det (A) 
ans = 

-6 
»% Inverse of a Matrix 
» inv (A) 
ans = 

-1.5000 0.5000 

0.8333 -0.1667 
»% Check 
»C=inv(A) ; 
»A*C 
ans = 

1.0000 0.0000 

0.0000 1.0000 
»% Solve A A -1*B 
»A\B 
ans = 

-1.0000 10.5000 
1.6667 -5.8333 
»% Solve A*B A -1 
»A/B 
ans = 

-0.4286 0.2714 

-1.2857 1.0143 
»% Eigenvalues of a Matrix 
» eig(A) 
ans = 

-0.5678 

10.5678 
»% Coefficients of Characteristic Equation (as A 2+bs+c) 
» poly (A) 
ans = 

1.0000 -10.0000 -6.0000 
»% Roots of Characteristic Equation ( as A 2+bs + c=0) 
»ce=[l -10 -6] ; 
» roots ( ce ) 
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ans = 

10.5678 

-0.5678 
»% Note that roots (ce) and eig(A) give the same result 
»% Transpose of a Matrix 
»A' 
ans = 

1 5 

3 9 
»% Rank of a Matrix 
» r ank ( A ) 
ans = 

2 
»% Create an Identity Matrix 
» I=eye ( 3 ) ; 
»I 
1 = 

10 
10 
1 

»% Condition of a Matrix 

»% The higher the Condition Number, the more ill-conditioned the 

» % matrix is 

»% LoglO of Condition Number gives approx. number of decimal 

»% places 

»% lost due to round-off errors 

»cond(A) 

ans = 

19.2815 
» % Tutorial End 

The above session may be printed by clicking 

File — ► Print 
MATLAB may be closed by clicking 

File— ►Exit MATLAB 



A1.3 Tutorial 2: Time domain analysis 

This tutorial introduces the reader to time domain analysis using MATLAB. It uses 
commands from the Control System Toolbox. A list of the commands can be found using 

»help control 

More information on individual commands can be obtained, for example 

»help step 

will provide more detail on how to use the step command. 

Script files'. A script file is an ASCII text file of MATLAB commands, that can be 
created using 
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(a) a text editor 

(b) the MATLAB editor/debugger 

(c) a word processor that can save as pure ASCII text files. 

A script file should have a name that ends in \m', and is run by typing the name of 
the file (without '.m') after the MATLAB prompt, or by typing the sequence 

File — ► Run Script — ► enter file name 

The advantage of a script file is that it only needs to be created once and saves the 
labour of continually typing lists of commands at the MATLAB prompt. 

The examples given in this tutorial relate to those solved in Chapter 3. Consider 
a first-order transfer function 

G(s)=l/l+s 

The impulse response function (Example 3.4, Figure 3.11) can be created by the 
following script file 

File name: examp34.m 

%impulse response of transfer function G( s ) =num( s ) /den ( s ) 

%num and den contain polynomial coefficients 

%in descending powers of s 

elf 

num=[ 1] ; 

den=[ 1 1 ] ; 

impulse (num,den); 

grid; 

pr intsys (num, den, ' s ' ) ; 

This shows how a transfer function is entered into MATLAB, where num = [1] is the 
numerator (K = 1) and den= [ 1 1] represents the V coefficient and the 6 s° 9 
coefficient respectively. 'Impulse (num, den) computes and plots the impulse 
response and grid produces a rectangular grid on the plot. Pr intsys (num, 
den, ' s ' ) prints the transfer function at the MATLAB prompt. A hard copy 
can be obtained by selecting, from the screen plot 

File — ► Print 

The step response of a first-order system (Example 3.5, Figure 3.13) is obtained using 
the step command 

File name: examp35.m 

% step response of transfer function G ( s) =num( s ) /den ( s ) 

%num and den contain polynomial coefficients 

%in descending powers of s 

elf 

num=[ 1] ; 

den=[ 1 1 ] ; 

step (num, den) ; 

gr id; 

pr intsys (num, den, ' s ' ) ; 



//SYS21 /D:/B&H3B2/ACE/REVISES(08-08-01 )/ACED01 .3D - 384 - [380-423/44] 9.8.2001 2:43PM 



384 Advanced Control Engineering 

SIMULINK: The Control System Toolbox does not possess a 'ramp' command, but 
the ramp response of a first-order system (Example 3.6, Figure 3.15) can be obtained 
using SIMULINK, which is an easy to use Graphical User Interface (GUI). SIMU- 
LINK allows a block diagram representation of a control system to be constructed 
and real-time simulations performed. 

With MATLAB Version 5.3, typing simulink at the MATLAB prompt brings 
up the SIMULINK Library Browser. Clicking on the 'Create new model' icon in the 
top left-hand corner creates a new window called 'untitled'. 

Clicking on the El icon attached to SIMULINK lists the SIMULINK options, 
and El Continuous lists the continuous systems options. To obtain a transfer func- 
tion block, click and hold left mouse button on the 'Transfer Fen' icon under 
'Continuous', and drag to 'untitled' window. 

Click on B to close down 'Continuous' and click on E 'Sources' to drag 'Ramp' 
from Browser to 'untitled' window. Close down 'Sources' and click on E 'Sinks' to 
drag 'Scope' to 'untitled'. Holding down left mouse button connect 'Ramp', 'Trans- 
fer Fen' and 'Scope' together as shown in Figure A 1.1. 

Double click on 'Scope' to bring up scope screen, and, in 'untitled', click 'Simula- 
tion' and 'Start'. The ramp response should appear on the scope screen. Click on the 
scope screen and choose autoscale (binoculars). Click print icon to obtain a hard 
copy of the ramp response. In the 'untitled' window, click on 'File' and 'Save As' 
and save as a '.mdl' (model) file in a directory of your choice (i.e. examp36.mdl in 
'work'). 

The transfer function for a second-order system can easily be obtained in terms of 
uj n and ( using the ord2 command. This has co n and ( as input arguments and 
generates the numerator and denominator of the equivalent transfer function. The 
script file sec_ord.m shows how Figure 3.19 can be generated using the ord2 and 
step MATLAB commands 

File name: sec_ord.m 

%Second-order system 

t=[0:0.1:15] ; 

wn=l; 
zeta=0.2; 

[num,den]=ord2(wn,zeta) ; 
[y , x , t ] =step (num, den, t ) ; 
zeta = 0.4; 

[numl,denl] =ord2(wn,zeta) ; 
[yl ,x , t ] =step (numl , denl, t ) ; 
zeta=0.6 ; 

[num2 , den2 ] =ord2 (wn, zeta) ; 
[y2 , x , t ] =step (num2 , den2 , t ) ; 
plot (t ,y,t,yl,t,y2) ; 
grid; 

In sec_ord.m a user supplied common time base (t = 0-15 seconds in 0.1 second 
intervals) has been set up. The plot command superimposes the step responses for 
zeta = 0.2, 0.4 and 0.6. 

The step response for Example 3.8, the resistance thermometer and valve, shown in 
Figure 3.23 can be generated with script file examp38.m. 
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Fig. A1 .1 SIMUUNK model for the ramp response of a first-order system. 
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File name: examp38.m 

%Step response of a third-order system 

%G(s)=12.5/(s+0.5) (s A 2+s+25) 

elf 

num=[12.5] ; 

den=conv([l 0.5 ] , [ 1 1 25]); 

step (num, den) ; 

grid; 

The transfer function is based on equation (3.75), with the input term X[(s) = l/s 
removed. The denominator is input using the conv command (short for convolu- 
tion), which multiplies two polynomial expressions together. 



A1.4 Tutorial 3: Closed-loop control systems 

This tutorial shows how MATLAB can be used to build up and test closed-loop 
control systems. The examples given relate to those solved in Chapter 4. The com- 
mands used in MATLAB to create a single model from the elements in the control 
loop are 

Command Operation 

series Combines blocks in cascade, see Transformation 1, Table 4.1 

parallel Combines blocks in parallel, see Transformation 2, Table 4.1 

feedback Eliminates a feedback loop, see Transformation 4, Table 4.1 

cloop Closes the loop with unity feedback. 

Example 4.5 is a PI controlled liquid-level system shown in Figure 4.26. In the block 
diagram representation, Figure 4.27, the system parameters are 

Ki = l; T t = 5 seconds; A: v = 0.1m 3 /sV 
R f = l5s/m 2 ; .4 = 2m 2 ; H x = 1 

The PI controller and control valve transfer function is therefore 

0.5^ + 0.1 



G c (s) = 



and the plant transfer function is 



G P (s) 



5s 
15 

307TT 
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Since H\ = 1, the system has unity feedback, and the closed-loop transfer function 
and step response is given by 



Filename: examp45.m 

%Example 4.5 (Liquid-Level Process Control System) 
%Use of series and cloop 
numc = [ 0.5 0.1 ] ; 
denc=[ 5 ] ; 
nump=[ 15 ] ; 
denp=[ 30 1 ] ; 

[numol ,denol]=series (numc , dene ,nump , denp) ; 
[numel , dene l]=c loop (numol , denol) ; 
printsys ( numc 1, dene 1 , ' s ' ) ; 
step (numel , dencl) ; 
grid; 

Case study Example 4.6.1 is a CNC machine-tool positional control system, whose 
block diagram representation is shown in Figure 4.31. When system parameter values 
are inserted, the block diagram is as shown in Figure A1.2. 
The closed-loop transfer function and step response is given by 



Filename: examp461.m 

%Case Study Example 4.6.1 (CNC Machine-Too 1 Positional Control) 
%Use of series and feedback 
nump=[80] ; 
denp=[ 0.45 ] ; 
numpl=[ 0.365] ; 
denpl=[ 1 ] ; 
numvf=[ 0.697] ; 
denvf=[l] ; 
numpf=[60] ; 
denpf =[ 1] ; 

[num, den]=f eedback (nump , denp , numvf , denvf ) ; 
[numfp , denfp]=ser ies (num, den, nump 1, denpl) ; 
[numel , dencl]=f eedback (numfp , denfp ,numpf , denpf ) ; 
printsys (numel, dencl , ' s ' ) ; 
step (numel, dencl) ; 
grid; 

In this example, the inner loop is solved first using feedback. The controller and 
integrator are cascaded together ( nump 1 , d e np 1 ) and then series is used to 
find the forward-path transfer function (numfp , denfp ). Feedback is then 
used again to obtain the closed-loop transfer function. 

The time response of the CNC control system is also obtained using SIMULINK 
as shown in Figure A 1.3. Note that the variables t and x have been sent to work- 
space, an area of memory that holds and saves variables. The commands who and 
whos lists the variables in the workspace. The system time response can be obtained 
by the command 

plot (t ,x ) 



//SYS21/D:/B&H3B2/ACE/REVISES(08-08-01)/ACED01.3D - 387 - [380-423/44] 9.8.2001 2:43PM 



Appendix 1 Control system design using MATLAB 387 



Controller 



Amplifier, Motor 
and Machine Table 



Integrator 



x d (s) 



?) I. 


0.365 


-&- 


80 
0.45 s 






1 
s 




X (s) 


s 














ik 






















0.697 


< 






Tachogenerator 






60 

























Position Transducer 
Fig. A1.2 CNC machine-tool positional control system. 
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Position 
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Fig. A1.3 SIMUUNK simulation of CNC machine-tool positional control system. 

Case study Example 4.6.2 is a PID temperature control system, and is represented by 
the block diagram in Figure 4.33. Here, the PID control transfer function is not 
'proper', and the series command does not work. The forward path transfer 
function, with values inserted, is 



GfpO) : 



29.412s 2 + 39.216s +13.072 
3s(4s+l)(8s+l) 



The closed-loop transfer function and step response is given by 

Filename: examp462.m 

%Case study example 4.6.2 (Temperature Control) 
%Use of feedback 
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numfp=[ 29.412 39.216 13.072]; 
denfp=conv( [ 3 0],conv([4 1],[8 1])); 
numtf =[ 1] ; 
dentf=[l] ; 

[numcl, dencl]=f eedback (numfp , denfp , numtf , dentf ) ; 
pr intsys (numcl, dencl , ' s ' ) ; 
step (numcl, dene 1) ; 
grid; 

Case study Example 4.6.3 is a ship autopilot control system. The block diagram 
representation is given by Figure 4.37. Inserting system parameters gives a forward- 
path transfer function 

The closed-loop transfer function and step response is given by 

Filename: examp463.m 

%Case study example 4.6.3 (Ship Autopilot Control System) 
%Use of feedback 
numfp = [0.2] ; 
denfp = [20 2 ] ; 
numhf =[ 1] ; 
denhf=[l] ; 

[numcl, dencl]=f eedback (numfp , denfp , numhf , denhf ) ; 
pr intsys (numcl, dencl , ' s ' ) ; 
step (numcl, dencl) ; 
grid; 



A1.5 Tutorial 4: Classical design in the s-plane 

The tutorial demonstrates how MATLAB is used to generate root locus diagrams, 
and hence how to design control systems in the s-plane. Examples given in Chapter 5 
are used to illustrate the MATLAB commands. The roots of the characteristic 
equation (or any polynomial) can be found using the roots command. 

Example 5.1 

Check the stability of the system that has the characteristic equation 

As + 2 = 





s 4 


+ 2s 3 


+ * 2 


At the MATLAB prompt type 






»ce=[l 2 14 


2] ; 






» roots (ce) 








ans= 








-2.1877 








0. 3516+1. 2843i 








0. 3516-1. 2843i 








-0.5156 









Two roots have positive real parts, hence the system is unstable. 
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Example 5.2 

What values of K\ make the following system unstable 

G(s)H(s) : 8 * 



s(s 2 + s + 2) 



Filename: examp52.m 

%Roots of denominator of closed-loop transfer function 

kl=0.25 

num=[8*kl] ; 

den=conv([l 0],[1 1 2]); 

[numcl , dencl] =cloop (num, den) ; 

roots (dencl) 

Running examp52.m with K\ set to 0.25, 0.15 and 0.35 gives 

» e x amp 5 2 
kl= 

0.2500 



0. 0000+1. 4142i 
0. 0000-1. 4142i 
-1.0000 

» e x amp 5 2 
kl= 

0.1500 



-0. 1630+1. 3243i 
-0. 1630-1. 3243i 
-0.6740 

» e x amp 5 2 
kl= 

0.3500 

ans= 

0. 1140+1. 5057i 
0. 1140-1. 5057i 
-1.2280 

Hence, with K\ =0.15, the system is stable, K\ = 0.25, the system has marginal 
stability and K\ = 0.35, the system is unstable. 

Example 5.8 

The root locus for 

G(s)H(s) K 



s(s + 2)0 + 5) 
can be drawn using the r locus command as shown in examp58.m 



//SYS21 /D:/B&H3B2/ACE/REVISES(08-08-01 )/ACED01 .3D - 390 - [380-423/44] 9.8.2001 2:43PM 



390 Advanced Control Engineering 

Filename: examp58.m 

%Example 5.8 Simple root locus 

%G(s)=K/s(s+2) (s+5) 

elf 

num=[ 1] ; 

den=conv(conv( [ 1 0],[1 2]),[1 5]); 

rlocus (num, den) ; 

axis ([-9 2 -4 4 ] ) ; 

%axis ( ' square ' ) ; 

With no axis command, the axes are generated automatically. Alternatively, user 
defined axes can be generated with axis ( [x min x max y min y max ] ) . Using the 
command 'square' generates the same scales on both x and y axes. With 
examp58.m it is easy to experiment with all three methods. 

Using MATLAB to design a system, it is possible to superimpose lines of constant 
C and u n on the root locus diagram. It is also possible, using a cursor in the graphics 
window, to select a point on the locus, and return values for open-loop gain K and 
closed-loop poles using the command 

[k, poles]=relocf ind(num, den) 

The script file examp58a.m shows how this is achieved 

Filename: examp58a.m 

%Example 5.8 Root locus 

%G(s)=K/s(s + 2) (s + 5) 

elf 

num=[ 1] ; 

den=conv(conv) [ 1 0],[1 2]),[1 5 ] ) ; 

rlocus (num, den) ; 

axis ([-9 2 -4 4 ] ) ; 

zeta=0.5 ; 

wn=2:2: 8 ; 

sgr id ( zeta,wn) ; 

[k, poles] =rlocf ind(num,den) 

Here a line of C, = 0.5 (/? = 60°) is drawn together with four u n circles (u n = 2, 4, 6 
and 8rad/s.) At the MATLAB prompt, the user is asked to select a point in the 
graphics window. If the intersection of the complex locus with the ( = 0.5 line is 
selected (see Figure 5.14), the following response is obtained 

» e x amp 58a 

Select a point in the graphics window 

selected point= 

-0. 7143+1. 2541i 
k= 

11.5754 
poles= 

-5.5796 

-0. 7102 + 1. 2531i 

-0.7102-1.253H 

Example 5.9 is solved using examp59.m to create Figure 5.16. 
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Filename : examp59.m 



%Example 5.9 Root Locus 

%G(s)=K/s(s A 2+4s+13) 

elf 

num= [ 1 ] ; 

den=conv([l 0],[1 4 13]); 

rlocus (num, den) ; 

axis ([-9 2 -4 4]); 

zeta=0.25 ; 

wn= 3 ; 

sgr id( zeta,wn) ; 

k=r locf ind (num, den) %Select k from graphic window 

When run, the program invites the user to select a point in the graphics window, which 
may be used to find the value of 7^ when ( = 0.25. If the last line ofexamp59.m is typed 
at the MATLAB prompt, the cursor re-appears, and a further selection can be made, 
in this case to select the value of K for marginal stability. This is demonstrated below 

» e x amp 5 9 

Select a point in the graphics window 
selected_point= 

-0. 7429 + 2. 9175i 
k= 

22.9452 
»k=r locf ind (num, den) 

Select a point in the graphics window 
selected_point= 

0+3.6304i 
k= 

52.7222 
» 

Example 5.10 uses the root locus method to design a PD controller that will allow the 
system 

G ^ H ^ = ( uol ^ 

s(s + 2)0 + 5) 

To meet a given time-domain specification. In examp510.m, the PD controller takes 
the form 

G c (s) = K l (s + 2) 

Filename: examp510.m 



%Example 5.10 Root Locus 








%G(s)=K(s+2)/s(s+2) ( 


s+5) 








elf 










num= [1 2 ] ; 










den=conv(conv( [ 1 0] 


,[1 


2]) 


,[1 


5]); 


rlocus (num, den) ; 










axis ([-9 2 -4 4 ] ) ; 










zeta=0.7 ; 










wn=3.5 ; 










sgr id( zeta,wn) ; 










k=r locf ind (num, den) %Select k from screen 
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num= [ k k * 2 ] ; 

[numcl , dencl] =cloop (num, den) ; 

step (numcl, dene 1) ; 

grid; 

This produces the (pole-zero cancellation) root locus plot shown in Figure 5.18. 
When run, examp510.m allows the user to select the value of K\ that corresponds 
to C = 0.7, and then uses this selected value to plot the step response. The text that 
appears in the command window is 

»examp510 

Select a point in the graphics window 

selected_point= 

-2. 4857+2. 5215i 
k= 

12.6077 
» 

Case study Example 5.11 uses root locus to design a ship roll stabilization system. 

The script file examp5ll.m considers a combined PD and PID (PIDD) controller of 

the form 

^ + 2X^+4^ + 8) 
G c (s) = 



Filename: examp511.m 

%Example 5.11 Root Locus 

%G(s)=K(s+2) (s A 2+4s+8)/s(s+l) (s A 2+0.7s+2) 

elf 

num=conv ( [ 1 2 ] , [ 1 4 8 ] ) ; 

den=conv(conv( [ 1 0],[1 1]),[1 0.7 2]); 

r locus (num, den) ; 

axis ([-9 2 -4 4 ] ) ; 

zeta=0.7 ; 

wn=4.2 ; 

sgr id ( zeta,wn) ; 

k=r locf ind (num, den) % Select k from screen 

num=k*conv( [ 1 2],[1 4 8]); 

[numcl , dencl] =cloop (num, den) ; 

step (numcl, dencl) ; 

grid; 

This script file produces the root locus shown in Figure 5.24 and allows the user to 
select the value of K furthest from the imaginary axis that corresponds to £ = 0.7. 
The command window text is 

» e x amp 511 

Select a point in the graphics window 

selected_point= 

-3. 2000+3. 2607i 
k= 

10.2416 
» 

When K has been selected, the roll angle step response, as shown in Figure 5.25 is 
plotted. 
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A1.6 Tutorial 5: Classical design in the fre 
domain 



iquency 



This tutorial shows how MATLAB can be used to construct all the classical fre- 
quency domain plots, i.e. Bode gain and phase diagrams, Nyquist diagrams and 
Nichols charts. Control system design problems from Chapter 6 are used as examples. 

Example 6.1 

Construct the Bode diagram for 

G(s) 



1 + 0.5.9 



Filename: examp61.m 

%Example 6.1 Bode Diagram 
%First-order system 
num= [ 2 ] ; 
den=[ 0.5 1] ; 
bode (num, den) ; 

The Nyquist diagram for the same system is 

Filename: examp61a.m 

%Example 6.1(a) Nyquist Diagram 
%First-order system 
num= [ 2 ] ; 
den=[ 0.5 1] ; 
nyquist (num, den) ; 

The script file examp61b.m shows how it is possible to customize a Bode diagram 

Filename: examp61b.m 

%Example 6.1(b) 
%Customizing a Bode Diagram 
elf 

num= [ 2 ] ; 
den=[ 0.5 1] ; 

w=logspace (-1 , 2 , 200) ; %w f rom 10 A -1 to 10 A 2 , 2 00 points 
[mag, phase ,w] =bode (num, den,w) % cal mag and phase 
semilogx (w, 20*logl0 (mag) ) ,grid; 
x lab el ( 'Frequency (rad/s) ' ) , y label ( 'Gain dB ' ) ; 

The logspace command allows a vector of frequencies to be specified by the 
user, in this case, 200 points between 10 _1 and 10 2 (rad/s). The bode command has a 
left-hand argument [ mag , phas e , w ] which allows the magnitude and phase to be 
calculated, but not displayed. The semilogx command plots the magnitude (con- 
verted to deciBels) against log frequency, and gr id provides a log-linear grid. Script 
file examp62.m produces a second-order Bode gain diagram for Example 6.2. 
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Filename: examp62.m 

%Example 6.2 Bode Diagram 
%Second-order system 
elf 

num= [ 4 ] ; 

den=[0.25 0.2 1] ; 
w=logspace (-1 , 2 , 200) ; 
[mag, phase ,w] =bode (num, den,w) ; 
semilogx(w, 20*logl0(mag)) , gr id^- 
xlabel ( ' Frequency (rad/s) ' ) ,ylabel ('GaindB') 

The Nyquist diagram (uj varying from — oo to +oo) is produced by examp64.m 
where 

Filename: examp64.m 

%Example 6.4 Nyquist Diagram 

%Third-order type one system 

num= [ 1 ] ; 

den=conv( [1 0] , [ 1 2 4 ] ) ; 

nyquist (num, den) ; 

axis ([-0.6 0.1 -0.6 0.1]); 

Note that to obtain a reasonable diagram, it is usually necessary for the user to define the 
scales of the x and y axes using the axis command. The script file examp64a.m produces 
the Bode gain diagrams for the same system when K = 4 and 8, see Figure 6.23(a). 

Filename: examp64a.m 

%Example 6.4 (a) 

G(s)=K/s(s A 2+2s+4) 

%Creates Bode Gain Diagrams for K=4 and 8 

elf 

num= [ 4 ] ; 

den=conv([l 0],[1 2 4 ] ) ; 

w=logspace (-1 , 1 , 200) ; 

mag, phase ,w] =bode (num, den,w) ; 

semilogx (w, 20*logl0 (mag) ) ; 

num= [ 8 ] ; 

[magi ,phasel ,w] =bode (num, den,w) ; 

semilogx (w, 20*logl0 (mag) ,w, 20*logl0 (magi) ) ,grid; 

x lab el ( ' Frequency (rad/s ) ' ) , ylabel ( 'Gain ( dB ) ' ) 

Using the command margin (mag, phase ,w) gives 

(a) Bode gain and phase diagrams showing, as a vertical line, the gain and phase 
margins. 

(b) a print-out above the plots of the gain and phase margins, and their respective 
frequencies. 

This is illustrated by running examp64b.m, which confirms the values given in Figure 
6.23, when K = 4. 
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Filename: examp64b.m 

%Example 6.4(b) 
%G(s)=K/s(s A 2+2s+4) 

%Creates a Bode Gain and Phase Diagrams for K=4 
%Determines Gain and Phase Margins 
elf 

num= [ 4 ] ; 

den=conv([l 0],[1 2 4]); 
w=logspace (-1 , 1 , 200) ; 
[mag, phase ,w] =bode (num, den,w) ; 
margin (mag, phase ,w) ; 
x lab el ( 'Frequency (rad/s) ' ) ; 

Script file fig627.m produces the Nichols chart for Example 6.4 when K — 4, as 
illustrated in Figure 6.27. The command ngrid produces the closed-loop magni- 
tude and phase contours and axis provides user-defined axes. Some versions of 
MATLAB appear to have problems with the nichols command. 

Filename: fig627.m 

%Example 6 . 4 as displayed in Figure 6.27 

%G(s)=K/s(s A 2+2s+4) where K=4 

%Nichols Chart 

num= [ 4 ] ; 

den=conv([l 0],[1 2 4 ] ) ; 

nichols (num, den) ; 

ngrid; 

axis ([-210 -30 40]); 

Running script file fig629.m will produce the closed-loop frequency response gain 
diagrams shown in Figure 6.29 for Example 6.4 when K = 3.8 and 3.2 (value of K 
for best flatband response). 

Filename: fig629.m 

%Example 6 . 4 as displayed in Figure 6.29 
%G(s)=K/s(s A 2+2s+4) 

%Creates closed-loop Bode Gain Diagrams for K=3.8 and 3.2 
%Prints in Command Window Mp,k,wp and bandwidth 
elf 

num=[3.8] ; 

den=conv([l 0],[1 2 4 ] ) ; 
w=logspace (-1 , 1 , 200) ; 
[numel , dencl] =cloop (num, den) ; 
[mag,phase,w] =bode (numel , dencl ,w) ; 
[Mp / k]=max(20*logl0(mag) ) 
wp=w (k) 
n=l; 

while 20*logl0 (mag(n) )> =-3 ,n=n+l ; end 
bandwidth=w(n) 
num= [ 3.2 ] ; 

[num2cl , den2cl] =cloop (num, den) ; 
[magl,phasel,w] =bode (num2cl , den2cl ,w) ; 
semilogx (w, 20*logl0 (mag) ,w, 20*logl0 (magi) ) ,grid; 
xlabeK 'Frequency (rad/s) ' ) ,ylabel ( 'Gain)dB) ' ) 
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The command cloop is used to find the closed-loop transfer function. The com- 
mand max is used to find the maximum value of 20 logi (mag), i.e. M p and the 
frequency at which it occurs i.e. u p = uj(k). A while loop is used to find the —3 dB 
point and hence bandwidth = uj ( n ) . Thus, in addition to plotting the closed-loop 
frequency response gain diagrams, fig629.m will print in the command window: 

» 
Mp = 

3.1124 
k= 

121 
wp= 

1.6071 
bandwidth= 

2.1711 

Case study 

Example 6.6 

This is a laser guided missile with dynamics 

G(s)H(s) 2 ° 



The missile is to have a series compensator (design one) of the form 

K(l+s) 



G(s) 



(1 + 0.25s) 



Figure 6.34 is generated using fig634.m and shows the Nichols Chart for the uncom- 
pensated system. Curve (a) is when the compensator gain K = 1, and curve (b) is 
when K = 0.537 (a gain reduction of 5.4 dB). 

Filename: fig634.m 

%Nichols Chart for Case Study Example 6.6 
%Lead Compensator Design One, Figure 6.34 
elf 

%Uncompensated System 
num=[20] ; 
den=[ 15 0]; 
w=logspace (-1 , 1 , 200) ; 
[mag, phase ,w] =nichols (num, den,w) ; 
%Compensator Gain set to unity 
numl=[20 20] ; 

denl=conv( [0.25 1],[1 5 ] ) ; 
[magl,phasel,w] =nichols (numl , denl ,w) ; 
%Compensator Gain reduced by 5.4dB 
num2=[ 10.74 10.74 ] ; 
den2=conv( [0.25 1],[1 5 ] ) ; 
[mag2 , phase 2 ,w] =nichols (num2 , den2 ,w) ; 
plot (phase , 20*logl0 (mag) ,phasel , 20*logl0 (magi) , 
phase2,20*logl0(mag2) ) 
ngr id; 
axis ([-240 -60 -20 30]); 
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A1.7 Tutorial 6: Digital control system desigi 

This tutorial looks at the application of MATLAB to digital control system design, 
using the problems in Chapter 7 as design examples. 

Example 7.3 

To obtain the z-transform of a first-order sampled data system in cascade with 

a zero-order hold (zoh), as shown in Figure 7.10. 

Filename: examp73.m 

%Example 7.3 Transfer Function to z-Transform 
%Continuous and Discrete Step Response 
num= [ 1 ] ; 
den=[ 1 1] ; 
Ts=0.5; 

[numd, dend] =c2dm(num, den,Ts , 'zoh' ) ; 
pr intsys (num, den, ' s ' ) 
pr intsys (numd, dend, ' z ' ) 
subplot ( 121) , step (num, den) ; 
subplot ( 122 ) , dstep (numd, dend) ; 

The continuous to discrete command c 2 dm employs a number of conversion meth- 
ods in the last term of the right-hand argument. These include 

' zoh ' zero-order hold 

' f oh ' first-order hold 

' tust in ' tustin's rule (see equation 7.102) 

The command subp lo t ( mnp ) creates an m-by-n array of equal sized graphs, the 
argument p indicates the current graph. Thus subplot {\2p) produces a single row, 
two column array (i.e. side by side graphs). When p = 1, the left-hand graph is 
produced and when p = 2, the right-hand one is produced. Running examp73.m 
generates step response plots of both continuous and discrete systems, with the 
following text in the command window 

» 

num/den= 

1 

i+T 

num/den= 

0.39347 



z-0. 60653 



Example 7.4 

This is a closed-loop digital control system as shown in Figure 7.14, with a plant 

transfer function 

s(s + 2) 
Filename: examp74.m 

%Example 7.4 Open and Closed-Loop Pulse Transfer Functions 
%Discrete Step Response 
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num= [ 1 ] ; 

den=conv[ 1 ] , [ 1 2 ] ; 

Ts=0.5; 

[numd, dend] =c2dm(num, den,Ts , ' zoh' ) ; 

[numcld, dencld] =cloop (numd, dend) ; 
pr intsys (num, den, ' s ' ) 
pr intsys (numd, dend, ' z ' ) 
pr intsys (numcld, dene Id, ' z ' ) 
dstep (numcld, dencld) ; 

Note that the command cloop works with both continuous and discrete systems. 
Running examp74.m will produce a step response plot of the closed-loop discrete 
system, and the open and closed-loop pulse transfer functions will be written in the 
command window 

» 

num/den= 
1 



s A 2+2s 
num/den= 

0.09197Z+0.06606 
z-2-1.3679z+0. 36788 
num/den= 

0.09197Z+0.06606 
z-2-1.2759z+0. 43394 



ssee equation (7.53) 



%see equation (7.55) 



The script file examp75.m simulates the Jury stability test undertaken in Example 7.5. 
With the controller gain K in Example 7.5 (Figure 7.14) set to 9.58 for marginal 
stability see equation (7.75), the roots of the denominator of the closed-loop pulse 
transfer function are calculated, and found to lie on the unit circle in the z-plane. 

Filename: examp75.m 

%Example 7.5 Stability in the z-plane 
K=9.58 
num= [ K ] ; 

den=conv([l 0],[1 2 ] ) ; 
Ts=0.5; 

[numd, dend] =c 2 dm (num, den,Ts , ' zoh' ) ; 
[numcld, dencld] =c loop (numd, dend) ; 
pr intsys (numcld, dencld, ' z' ) 
roots ( dencld) 

Running examp75.m produces command window text 

» 
K= 

9.5800 
num/den= 

0.88107z+0. 63286 



z-2-0.48681z+1.0007 



ans= 

0. 2434+0. 9703i %lies on unit circle i.e. VRP 2 +IP 2 = 1 
0. 2434-0. 9703i %see equation (7.87) 
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Example 7.6 constructs the root-locus in the z-plane for the digital control system in 
Example 7.4 (Figure 7.14). 

Filename: examp76.m 

%Example 7.6 Root Locus Analysis in the z-plane 

num= [ 1 ] ; 

den=conv([l 0],[1 2 ] ) ; 

Ts=0.5; 

[numd, dend] =c2dm(num, den,Ts , ' zoh' ) ; 

r locus (numd, dend) ; 

axis ( ' square ' ) 

zgr id; 

k=r locf ind (numd, dend) 

Note that r locus and rlocfind works for both continuous and discrete sys- 
tems. The statement ' squar e ' provides square axes and so provides a round unit 
circle. The command zgr id creates a unit circle together with contours of constant 
natural frequency and damping, within the unit circle. When examp76.m has been 
run, using rlocfind at the MATLAB prompt allows points on the loci to be 
selected and values of K identified (see Figure 7.20) 

» Select a point in the graphics window 
selected_point= 

0. 2212+0. 9591i 
k= 

9.7078 
»k=r locf ind (numd, dend) 
Select a point in the graphics window 
selected_point = 

-2. 0876-0. 0117i 
k= 

60.2004 
k = rlocfind (numd, dend) 
Select a point in the graphics window 
selected_point= 

-1.0092-0. 0117i 
k= 

103.3290 

Example 7.7 

A laser guided missile has dynamics 

G(s)H(s) 2 ° 



' s 2 (s + 5) 
and a compensator 

0.8(1 +s) 



G c (s) 



(1 + 0.0625s) 



Script file examp77.m plots the closed-loop step responses of both the continuous 
system and discrete system (see Figure 7.21). In the latter case the plant pulse transfer 
function uses zoh, and the compensator is converted into discrete form using 
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Tustin's rule. Subplot (211) and (212) creates a 2 row, single column plot matrix (i.e. 
produces 2 plots, one beneath the other). 



Filename: examp77.m 

%Example 7.7 Digital Compensator using Tustin's Rule 
%Laser Guided Missile 
num=[20] ; 

den=conv([l 0],[1 5 ] ) ; 
Ts=0.1; 

ncomp=0.8* [1 1 ] ; 
dcomp=[0.0625 1] ; 

[nol,dol]=series (ncomp , dcomp ,num, den) ; 
[ncl,dcl] =cloop (nol,dol) ; 
[numd, dend] =c2dm(num, den,Ts , ' zoh' ) ; 
[ncomd, dcomd] =c2dm( ncomp , dcomp ,Ts , ' t us tin' ) ; 
pr intsys (num, den, ' s ' ) 
printsys (numd,dend, ' z' ) 
pr intsys (ncomp , dcomp , ' s ' ) 
printsys (ncomd, dcomd, ' z ' ) 

[nold,dold]=series (ncomd, dcomd ,numd, dend) ; 
[ncld,dcld] =cloop (nold,dold) ; 
subplot ( 211) , step (ncl, del) ; 
subplot (212 ) , dstep (ncld,dcld) ; 

The open continuous transfer functions and pulse transfer functions for the plant and 
compensator are printed in the command window 

» 

num/den= 
20 



s^3+5s A 2 
num/den= 

0.002 955 lz"2+0.010482z+0.002 302 
z-3-2.6065z-2+2.2131z-0.6065 3 
num/den= 
0.8S+0.8 
0.0625S+1 
num/den= 

7.4667z-6.7556 
z-0.11111 



ssee equation (7.108) 



ssee equation (7.110) 



Example 7.8 

Here pole placement is used to design a digital compensator that produces exactly the 

step response of the continuous system. 

Filename: examp78.m 

%Example 7.8 Digital Compensator Design using Pole Placement 
K=0.336 
numk=K* [3] ; 
num= [ 3 ] ; 
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den=conv([l 0],[1 1 ] ) ; 
Ts=0.5; 

[ncl ,dcl] =cloop (numk, den) ; 
ncomd=0.327* [ 1-0.6065 ] ; 
dcomd=[ 1-0.519] ; 

[numd, dend] =c2dm(num, den,Ts , ' zoh' ) ; 
[nold,dold]=series (ncomd, dcomd,numd, dend) ; 
[ncld, dcld] =cloop (nold, dold) ; 
pr intsys (num, den, ' s ' ) 
pr intsys (numd, dend, ' z ' ) 
pr intsys (ncomd, dcomd, ' z ' ) 
pr intsys (ncl, del, ' s ' ) 
pr intsys (ncld,dcld, ' z' ) 
subplot ( 211) , step (ncl, del) ; 
subplot (212 ) , dstep (ncld,dcld) ; 

The continuous and discrete closed-loop systems are shown in Figures 7.22(a) and 
(b). The digital compensator is given in equation (7.128). Script file examp78.m 
produces the step response of both systems (Figure 7.25) and prints the open and 
closed-loop continuous and pulse transfer functions in the command window 

» 
K= 

0.3360 
num/den= 
3 



s A 2+s 
num/den= 

0.31959Z+0.27061 

z-2-1.6065z+0. 60653 
num/den= 

0.327z-0. 19833 



z-0.519 
num/den= 

1.008 
s A 2+s+1.008 
num/den= 

0.1045 lz A 2+0.02 5 107Z-0.053669 
z-3-2. 02 lz-2 + 1.4654z-0. 36846 



^see equation (7.115) 
ssee equation (7.128) 



A1.8 Tutorial 7: State-space methods for control system 
design 



This tutorial looks at how MATLAB commands are used to convert transfer func- 
tions into state-space vector matrix representation, and back again. The discrete-time 
response of a multivariable system is undertaken. Also the controllability and obser- 
vability of multivariable systems is considered, together with pole placement design 
techniques for both controllers and observers. The problems in Chapter 8 are used as 
design examples. 
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Example 8.4 

This converts a transfer function into its state-space representation using 
tf2ss(num, den) and back again using ss2tf (A,B , C , D, iu) when iu 
is the ith input u, normally 1. 

Filename: examp84.m 

%Example 8.4 transfer function to state space representation 
%And back again 
num= [ 4 ] ; 
den=[l 3 6 2]; 
printsys (num,den, ' s ' ) 
[A,B,C,D]=tf2ss (num,den) 
[numl / denl]=ss2tf (A,B,C,D,1) ; 
printsys (numl , denl , ' s ' ) 
condit ion_number=cond (A) 

The print-out in the command window is 



» ex amp 84 




num/den= 






4 


s A 3+3s 


^2+6s+2 


A= 




-3 -6 


-2 


1 





1 





B= 




1 














c= 







4 


D= 









num/den= 




4.441e- 


-016s-2+5.329e-015s+4 



s^3+3s^2+6s+2 

condit ion_number= 
24.9599 

Comparing the output with equation (8.35) it will be noticed that the top and bottom 
rows of A have been swapped, which means that the state variables x\ and x^ have 
also been exchanged. This means that if the user is expecting the state variables to 
represent particular parameters (say position, velocity and acceleration), then the 
rows of A and B, and the columns of C might have to be re-arranged. 

The conversion from state-space to transfer function has produced some small 
erroneous numerator terms, which can be neglected. These errors relate to the 
condition of A, and will increase as the condition number increases. 

Example 8.8 uses c2d to calculate the discrete- time state and control transition 
matrices A(T) and B(T) as given by equations (8.78), (8.80), (8.82) and (8.85). The 
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matrix-vector difference equation (8.76) is then used to calculate the first five discrete 
values of the state variables when responding to a unit step input. 



Filename: examp88.m 

%Calculate state and control transition matrices 
A=[0 l;-2 -3] 
B=[0; 1] 
Ts=0.1 

[AT,BT]=c2d(A,B,Ts) 
%Compute discrete step response 
kT=0 
x=[0;0] 
u=l 

for i=l:5 

xnew=AT*x+BT*u; %Matr ix-vector difference equation (8.76) 

kT=kT+Ts 
x=xnew 
end 

The command window text is 

» e x amp 8 8 
A= 

1 
-2 -3 
B= 



1 
Ts= 

0.1000 
AT= 

0.9909 0.0861 
-0.1722 0.7326 

BT= 

0.0045 

0.0861 
kT= 


x= 




u= 

1 
kT= 

0.1000 
x= 

0.0045 

0.0861 
kT= 

0.2000 
x= 

0.0164 

0.1484 
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kT= 

0.3000 
x= 

0.0336 

0.1920 
kT= 

0.4000 
x= 

0.0543 

0.2210 
kT= 

0.5000 
x= 

0.0774 

0.2387 



The for-end loop in examp88.m that employs equation (8.76), while appearing very 
simple, is in fact very powerful since it can be used to simulate the time response of any 
size of multivariable system to any number and manner of inputs. If A and B are time- 
varying, then A(T) and B(T) should be calculated each time around the loop. The 
author has used this technique to simulate the time response of a 14 state-variable, 6 
input time-varying system. Example 8.10 shows the ease in which the controllability and 
observability matrices M and N can be calculated using c t r b and ob s v and their rank 
checked. 



Filename: examp810.m 

%Example 8. 10 

%Controllability and observability 

A=[-2 0;3 -5] 

B=[1;0] 

C=[l -1] 

D=[0] 

M=ctrb(A,B) 

rank_of_M=rank (M) 

system_order=length (A) 

N=(obsv(A,C) )' 

Rank_of_N=rank (N) 



The command window will display 

» examp810 
A= 

-2 

3 -5 
B= 

1 



c= 

1 -1 

D= 
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M= 
1 


-2 







3 




rank 


of 


_M= 


2 






system order 


2 






N= 
1 


-5 




-1 


5 




rank_ 


_of_ 


_N= 


1 







srank of M = system order . System completely 
scontrollable . 



%rank of N< system order . System is unobservable . 

Example 8.11 uses Ackermann's formula ( acker ) to calculate the elements of a 
regulator feedback matrix K, that places the closed-loop poles at some desired 
location in the s-plane. 

Filename: examp811.m 

%Example 8. 11 

%Regulator design using pole placement 
%G(s)=l/s(s+4) 
num= 1 ; 

den=conv([l 0],[1 4 ] ) ; 
pr intsys (num, den, ' s ' ) 
^convert to state space 
[A,B,C,D]=tf 2ss (num,den) ; 
%Check for controllability; 
rank_of_M=rank ( ctrb (A,B ) ) 
system_order=length (A) 

%Enter desired characteristic equation 
chareqn=[ 14 4] 

%Calculate desired closed-loop poles 
desiredpoles=roots ( chareqn) 

%Calculate feedback gain matrix using Ackermann's formula 
K=acker ( A,B , desiredpoles ) 
%Closed-loop state feedback system 
Asf=A-B*K; Bsf=B; Csf=C; Dsf =0 ; 
[numsf ,densf]=ss2tf(Asf,Bsf,Csf,Dsf); 
densf 
roots (densf) 

In examp811.m, the closed-loop transfer function is obtained and the roots of the 
denominator calculated to check that the closed-loop poles are at the desired loca- 
tions. The output at the command window is 

» e x amp 811 
num/den= 

1 

s^2+4s 

rank_of _M= 

2 
system_order { = } % Rank of M = system order hence system 

2 % is controllable 
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chareqn= 
14 4 
desiredpoles= 
-2 
-2 
K= 

4 
densf = 

14 4 
ans= 
-2 
-2 % Actual closed-loop poles = desired closed-loop poles 

Example 8.12 shows how acker uses the transpose of the A and C matrices to 
design a full-order state observer. 

Filename: examp812.m 

%Example 8. 12 

%Full-order observer design using pole placement 

A=[0 l;-2 -3] 

B=[0; 1] 

C=[l 0] 

D=[0] 

%Check for observability; 

N=obsv(A,C) 

rank_or_N=rank (N) 

system_order=length (A) 

%Enter desired characteristic equation 

chareqn=[l 10 100] 

%Calculate desired observer eigenvalues 

desired_eigenvalues=roots (chareqn) 

%Calculate observer gain matrix using Ackermann's formula 

Ke=acker (A' , C ' , desired_eigenvalues ) 

The command window text is 

» e x amp 812 
A= 

1 
-2 -2 

B= 



1 

c= 

1 
D= 


N= 

1 
1 

rank_of_N= 

2 
system_order= 

2 % Rank of N = system order hence system 
% is observable 
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chareqn= 

1 10 100 
desired_eigenvalues= 
-5. 0000+8. 6603i 
-5. 0000-8. 6603i 
Ke= 

7.0000 77.0000 % Agrees with equation (8.150) 

Example 8.13 illustrates the design of a regulator combined with a reduced-order 
state observer. 

Filename: examp813.m 

%Example 8. 13 

%Regulator and reduced-order observer design 

%Using pole placement 

%G(s)=l/s(s+2)(s+5) 

%Input in state-space format directly 

A=[0 1 0;0 1;0 -10 -7] 

B=[0;0; 1] 

C=[l 0] 

D=[0] 

%Regulator design 

%Check for controllability; 

rank_of_M=rank(ctrb (A,B) ) 

%Enter desired characteristic equation 

chareqn=[l 7 25 15 ] 

%Calculate desired closed-loop poles 

desiredpoles=roots (chareqn) ; 

%Calculate feedback gain matrix using Ackermann' s formula 

K=acker ( A,B , desiredpoles ) 

%Reduced-order observer design 

A1E=[1 0] 

AEE=[0 1;-10 -7] % See equation ( 8 . 163 ) 

obchareqn=[l 63.2 2039.4] 

observerpoles=roots( ob chareqn) ; 

%Calculate observer matrix using Ackermann' s formula 

Ke=acker ( AEE ' , A1E ' , observerpoles ) 

Note that the transposes of the partitioned matrices Ai e and A ee from equation 
(8.163) are used in acker to calculate K e for the reduced-order state observer. 
The command window output is 

» e x amp 813 
A= 

10 

1 

-10 -7 
B= 





1 

c= 

10 
D= 
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chareqn= 

1 7 25 15 
K= 

15.0000 15.0000 
A1E = 

1 
AEE = 

1 
-10 -7 
obchareqn= 

1.0e+003* 

0.0010 0.0632 2.0394 
Ke= 

1.0e+003* 

0.0562 1.6360 



Regulator feedback matrix 



%Reduced-order observer matrix 




A1.9 Tutorial 8: Optimal and robust control system 
design 

This tutorial uses the MATLAB Control System Toolbox for linear quadratic 
regulator, linear quadratic estimator (Kalman filter) and linear quadratic Gaussian 
control system design. The tutorial also employs the Robust Control Toolbox for 
multivariable robust control system design. Problems in Chapter 9 are used as design 
examples. 

Example 9.1 

This example uses the MATLAB command lqr to provide the continuous solution 

of the reduced matrix Riccati equation (9.25) 



Filename: examp91.m 

%Example 9. 1 

%Continuous Optimal Linear Quadratic Regulator (LQR) Design 
A=[0 1;-1 -2] 
B=[0; 1] 
Q= [ 2 ; 1 ] 
R=[l] 
[K,P,E]=lqr(A,B,Q,R) 

The output at the command window is 

» e x amp 9 1 
A= 

1 
-1 -2 

B= 



1 
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Q= 


2 
1 




R= 


1 




K= 








0.7321 


0.5425 


P= 








2.4037 


0.7321 




0.7321 


0.5425 


E = 








-1. 2712+0. 3406i 




-1.2712- 


-0.3406i 
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sState weighting matrix, see equation (9.8) 



^Control weighting matrix , see equation (9.8) 

estate Feedback gain matrix, see equations 
5(9.20) and (9.46) 



bRiccati matrix, see equation (9.45) 
5Closed-loop eigenvalues 



Example 9.2 

This example solves the discrete Riccati equation using a reverse-time recursive 
process, commencing with P(«) = 0. Also tackled is the discrete state- tracking 
problem which solves an additional set of reverse-time state tracking equations 
(9.49) to generate a command vector v. 

Filename: examp92.m 

%Example 9.2 

%Discrete Solution of Riccati Equation 
%Optimal Tracking Control Problem 
A=[0 1;-1 -1] ; 
B=[0; 1] ; 
Q=[ 10 0; 1] ; 
R=[l] ; 

F=[ 0.9859 -0.27; 0.08808 0.76677]; 
G=[ -0.9952 0.01409; -0.04598 -0.08808] ; 
S=[0; 0] ; %Initialize 
T=0; 
V=0; 
Ts=0.1; 

[AD,BD]=c2d(A,B,Ts) ; 
P= [ ; ] ; 
H=BD'*P; 
X=Ts*R+H*BD; 
Y=H*AD; 
K=X\Y; 

%Discrete reverse-time solution of the Riccati equations (9.29) 
%and (9.30) 

%Discrete reverse-time solution of the state tracking equations 
%(9.53) and (9.54) 
for i=l:200 
L=Ts*Q+K'*Ts*R*K; 
M=AD-BD*K; 

PP1=L+M'*P*M; %Value of Riccati matrix at time (N-(k+l) )T 
RIN=[-sin(0.6284*T) ; 0.6*cos ( 0.6284*T) ] ; 
SP1=F*S+G*RIN; 

V=-B'*SP1; %Value of command vector at time (N-(k+l))T 

S=SP1; 
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T=T+Ts ; 

P=PP1; 

H=BD'*P; 

X=Ts*R+H*BD; 

Y=H*AD; 

K=X\Y; %Value of feedback gain matrix at time 

%(N-(k+l))T 
end 

Checking values in the command window gives 



» ex amp 92 




»A 




A= 




1 




-1 -1 




»B 




B = 









1 




»Q 




Q= 




10 




1 




»R 




R= 




1 




»Ts 




Ts = 




0.1000 




»AD 




AD= 




0.9952 


0.0950 


-0.0950 


0.9002 


»BD 




BD= 




0.0048 




0.0950 




»K 




K= 




2.0658 


1.4880 


»P 




P= 




8.0518 


2.3145 


2.3145 


1.6310 



sState weighting matrix 
^Control weighting matrix 



^Discrete-time state transition matrix 



^Discrete-time control transition matrix 



^Discrete-time steady-state feedback gain 
's matrix, after 200 reverse-time iterations 



^Steady-state value of Riccati matrix 



The reverse-time process is shown in Figure 9.3. The discrete- time steady-state feed- 
back matrix could also have been found using lqrd, but this would not have 
generated the command vector v. The forward-time tracking process is shown in 
Figure 9.4 using K(kT) and y(kT) to generate u opt (kT) in equation (9.55). The script 
file kalfilc.m uses the MATLAB command lqe to solve the continuous linear 
quadratic estimator, or Kalman filter problem. 
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Filename: kalfilc.m 

%Continuous Linear Quadratic Estimator (Kalman Filter) 

A=[0 1;-1 -2] 

B=[0; 1] 

C=[l 0;0 1] 

D=[0] 

R=[0.01 0;0 1] 

Cd=[0.1 0;0 0.01] 

Q=[0.1 0;0 0.1] 

[K,P,E]=lqe(A,Cd,C,Q,R) 

The command window text is 



»kalf ilc 
A= 

1 
-1 -2 

B= 



1 
C= 

1 
1 

D= 


R= 

0.0100 
1.0000 
Cd= 

0.1000 
0.0100 

Q= 

0.1000 
0.1000 
K= 

0.1136 -0.0004 
-0.0435 0.0002 
P= 

0.0011 -0.0004 

-0.0004 0.0002 

E = 

-1. 0569+0. 2589i 

-1. 0569-0. 2589i 



^Measurement noise covariance matrix 
%Disturbance matrix 

%Disturbance noise covariance matrix 

%Kalman gain matrix 

%Estimation error covariance matrix 
%Closed-loop estimator eigenvalues 



The script file kalfild.m solves, in forward-time, the discrete solution of the Kalman 
filter equations, using equations (9.74), (9.75) and (9.76) in a recursive process. The 
MATLAB command lqed gives the same result. 



Filename: kalfild.m 

%Discrete Linear Quadratic Estimator (Kalman Filter) 

%The algorithm uses discrete transition matrices A(T) and Cd(T) 

A=[0 l;-2 -3] 
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Cd=[0.1 0;0 0.1] 
C=[l 0;0 1] 
ID=eye(2) ; 
Ts=0.1 

[AT,CD]=c2d(A,Cd,Ts) 
R=[0.01 0;0 1.0] 
Q=[0.1 0;0 0.1] 

%Discrete solution of Kalman filter equations 
%Initialize 

P1=ID; %Initial covariance matr ix=identity matrix 
P2=(AT*P1*AT' )+(CD*Q*CD' ) ; 
X=P2*C; 
Y=(C*P2*C )+R; 
K=X/Y ; 

P3=(ID-(K*C) ) *P2; 
%Solve recursive equations 
for i=l:20 
P1=P3; 

P2=(AT*P1*AT' )+(CD*Q*CD' ) ; 
X=P2*C; 
Y=(C*P2*C )+R; 
K=X/Y ; 

P3=(ID-(K*C) ) *P2; 
end 

Checking results in the command window 

»kalfild 
A= 

1 
-2 -3 

Cd= 

0.1000 %Disturbance matrix 

0.1000 
C= 

1 
1 

Ts = 

0.1000 
AT= 

0.9909 0.0861 %Discrete-t ime state transition matrix 
-0.1722 0.7326 
CD= 

0.0100 0.0005 %Discrete-time disturbance transition 
-0.0009 0.0086 %matrix 

R= 

0.0100 ^Measurement noise covariance matrix 
1.0000 

Q= 

0.1000 %Disturbance noise covariance matrix 

0.1000 
»K 
K= 

0.0260 -0.0002 %Kalman gain matrix after 21 iterations 
-0.0181 0.0002 
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Case study 

Example 93 

This is a china clay band drying oven. The state and output variables are burner 
temperature, dryer temperature and clay moisture content. The control parameters 
are burner gas supply valve angle and clay feed-rate. A linear quadratic Gaussian 
control strategy is to be implemented. Script file examp93.m calculates the optimal 
feedback control matrix K and also the Kalman gain matrix K e using the recursive 
equation (9.99). 

Filename: examp93.m 

%Linear Quadratic Gaussian (LQG) Design 
%Case Study Example 9.3 Clay Drying Oven 
%Optimal Controller 

A=[-0. 02128 0;0.0006 -0.005 0;0 -0.00038 -0.00227] 
B=[8. 93617; 0; 0] 

Cd=[0.1 0;0 0.1 0;0 0.00132] 
C=[l 0;0 1 0;0 1] 
D=[0] 
Ts=2; 

[AT, BT] =c2d(A,B, Ts) 
Q=[0 0;0 0.5 0;0 20] 
R=[l] 

[K,P,E]=lqr(A,B,Q,R) 
%Kalman Filter 

Re=[0.01 0;0 0.01 0;0 7.46] 
Qe=[0.1 0;0 0.1 0;0 0.1] 
[AT,CD]=c2d(A,Cd,Ts) 
%Initialize 

%Implement equations (9.99) 
ID=eye(3) ; 

P1=ID; %Initial covariance matr ix=identity matrix 
P2=(AT*P1*AT' )+(CD*Qe*CD' ) ; 
X=P2*C f ; 
Y=(C*P2*C )+Re; 
Ke=X/Y; 

P3=(ID-(Ke*C) )*P2; 
%Solve recursive equations 
for i=l:19 
P1=P3; 

P2=(AT*Pl*AT') + (CD*Qe*CD' ) ; 
X=P2*C f ; 
Y=(C*P2*C )+Re; 
Ke=X/Y; 

P3=(ID-(Ke*C) )*P2; 
End 
Ke 
P3 

The output at the command window is 

» e x amp 9 3 
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-0.0213 
0.0006 -0.0050 
B= -0.0004 -0.0023 
8.9362 





Cd= 
C= 

D= 

AT= 

BT= 

Q= 

R= 

K= 

P= 



E = 



Re= 



CD= 



0.1000 

0.1000 %Disturbance matrix, equation 
0.0013 

10 
10 
1 



0.9583 

0.0012 0.9900 %A(T) , Ts=2 seconds 

0.0000 -0.0008 0.9955 

17.4974 %B(T), equation (9.86) 

0.0105 

0.0000 



0.5000 %State weighting matrix 

20.0000 

1 %Control weighting matrix 

0.0072 0.6442 -1.8265 %Feedback gain matrix , 

%equation (9.92) 

1.0e+003* 

0.0000 0.0001 -0.0002 

0.0001 0.0108 -0.0300 %Riccati matrix , equation 

-0.0002 -0.0300 3.6704 %(9.91) 



-0. 0449+0. 0422i %Closed-loop eigenvalues, 

%equation (9.93) 
-0. 0449-0. 0422i 
-0.0033 

0.0100 

0.0100 %Measurement noise covariance 

7.4600 %matrix, equation (9.100) 

Qe= 0.1000 

0.1000 %Disturbance noise covariance 

0.1000 %matrix, equation ( 9.101) 

0.1958 %Discrete-time disturbance 

0.0001 0.1990 %transition matrix, equation 

%(9.95) 
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Ke= 



P3= 



0.0000 -0.0001 0.0026 

0.4408 0.0003 0.0000 

0.0003 0.4579 0.0000 

0.0000 -0.0006 0.0325 

0.0044 0.0000 0.0000 

0.0000 0.0046 0.0000 

0.0000 0.0000 0.2426 
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%Kalman gain matrix after 20 
%iterations , 
%equation (9.102) 
% and Figure 9.16 

%Estimation error covariance 
%matr ix , 

%after 20 iterations, 
%equation (9.102) 



The implementation of the LQG design is shown in Figures 9.12 through to 9.17. 

Example 9.6 

This is a multivariate robust control problem that calculates the optimal H^ 
controller. The MATLAB command hinf opt undertakes a number of iterations 
by varying a parameter 7 until a best solution, within a given tolerance, is achieved. 



Filename: examp96.m 

%Example 9.6 

%Multivar iable robust control using H infinity 
%Singular value loop shaping using the weighted mixed 
%sensitivity approach 
nug=2 00 ; 

dng=[l 3 102 200]; 
[ag,bg, eg, dg] =tf 2ss (nug, dng) ; 
ss_g=mksys ( ag,bg, eg, dg) ; 
wl=[ 1 100; 100 1] ; 
nwlneg=[ 100 1 ] ; 
dwlneg=[ 1 100 ] ; 
w2=[l; 1] ; 

w3=[ 100 1; 1 100] ; 
nw3neg=[ 1 100 ] ; 
dw3neg=[ 100 1 ] ; 
[TSS_l]=augtf (ss_g / wl / w2 / w3) ; 
[ap ,bp , cp , dp] =branch (TSS_) ; 
[gamopt , ss_f , ss_cl] =hinf opt (TSS_, 1) ; 
[acp ,bcp , ccp,dcp] =b ranch ( ss_f ) ; 
[acl,bcl,ccl,dcl] =b ranch ( ss_cl) ; 
[numcp , dencp] =ss2tf ( acp , bep , ccp , dep , 1) ; 
pr intsys (nug, dng, ' s ' ) 
pr intsys (nwlneg, dwlneg, ' s ' ) 
pr intsys (nw3neg, dw3neg, ' s ' ) 
w=logspace (-3 , 3 ,200) ; 

% [mag, phase ,w] =bode (nwlneg, dwlneg, w) ; 
% [magl,phasel ,w] =bode (nw3neg, dw3neg,w) ; 
%semilogx (w, 20*logl0 (mag) ,w, 20*logl0 (magi) ) ,grid; 
[sv,w] =sigma( ss_g) ; 
% [sv,w] =sigma(ss_cl) ; 
% [sv,w] =sigma( ss_f ) ; 
semilogx (w,20*logl0 (sv) ) ,grid; 
ag 
bg 
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eg 

dg 

acp 

bep 

ccp 

dep 

pr intsys (numcp , dencp , ' s ' ) 



The command mksys packs the plant state-space matrices ag, bg, eg and dg into a 
tree structure ss_g. 

The command augtf augments the plant with the weighting functions as shown 
in Figure 9.31. The branch command recovers the matrices ap, bp, cp and dp 
packed in TSS_. The hinf opt command produces the following output in the 
command window 



No 


Gamma D 


11<=] 


. P-Exist 


P>=0 s- 


-Exist 


s>0 


lam(PS)< 


;1 C.L. 


1 


1.0000e+000 


OK 


OK 


FAIL 


OK 


OK 


OK 


UNST 


2 


5.0000e-001 


OK 


OK 


FAIL 


OK 


OK 


OK 


UNST 


3 


2.5000e-001 


OK 


OK 


FAIL 


OK 


OK 


OK 


UNST 


4 


1.2500e-001 


OK 


OK 


OK 


OK 


OK 


OK 


STAB 


5 


1.8750e-001 


OK 


OK 


FAIL 


OK 


OK 


OK 


UNST 


6 


1.5625e-001 


OK 


OK 


FAIL 


OK 


OK 


OK 


UNST 


7 


1.4063e-001 


OK 


OK 


FAIL 


OK 


OK 


OK 


UNST 


8 


1.3281e-001 


OK 


OK 


FAIL 


OK 


OK 


OK 


UNST 


9 


1.2891e-001 


OK 


OK 


OK 


OK 


OK 


OK 


STAB 


10 


1.3086e-001 


OK 


OK 


FAIL 


OK 


OK 


OK 


UNST 


11 


1.2988e-001 


OK 


OK 


OK 


OK 


OK 


OK 


STAB 



Iteration no. 11 is your best answer under the tolerance: 0.0100. 

After eleven iterations, hinf opt identifies that 7 in equation (9.176) has a best 
value of 0.13. The command sigma calculates the data for a singular value Bode 
diagram as shown in Figures 9.32, 9.34 and 9.35. Other information printed in the 
command window is given below 



num/den= 






200 




%Plant 


s A 3+3s A 2 + 102 


s+200 


num/den= 






lOOs+1 
s+100 




%W s 1 (s) 


num/den= 






s+100 
lOOs+1 




%W T 2 ( s ) 


ag= 






-3 -102 - 


-200 




1 







1 








Plant transfer function 
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bg= 

cg= 
dg= 
acp= 



1 



200 





-0.0100 


-0.0022 


0.0039 


0.0148 


0.1367 


%Controller 
%matrices, 


-0.0086 


-7.7634 


21.6533 


37.1636 


621.8932 


%See equation 
%(9.178) 


-0.0461 


-2.0317 


-3.1477 


-2.2338 


-81.8751 




0.4353 


0.1067 


8.8071 


-102.2531 


-37.7767 




0.6756 


0.1970 


13.5575 


-3.7282 


-162.5129 




bcp= 












-7.9756 












0.0906 












0.5820 












-8.8009 












-13.6595 












ccp= 












-0.0861 


0.1698 


0.1213 


-0.6544 


-11.1708 




dcp= 

num/den= 























159.1184s A 4+16389.1905s A 3+63965.5 785s A 2 + 1654830.8855s+3 182 367.0874 
s-5+2 75.687s-4+20439.8141s-3+324835.0198s-2 + 3 782679. 1393S+37 794.3283 

%Controller transfer function, 
%See equation (9.179) 



A1.10 Tutorial 9: Intelligent control system design 

This tutorial uses the MATLAB Control System Toolbox, the Fuzzy Logic Toolbox 
and the Neural Network Toolbox. Problems in Chapter 10 are used as design examples. 

Example 103 

This is the inverted pendulum control problem and, as a benchmark, is initially 
solved as a multivariable control problem, using pole placement (Ackermann's 
formula) to calculate the feedback gain matrix in exampl03.m. 

Filename: exampl03m 

%Regulator design using pole placement 

%Inverted pendulum problem 

A=[0 1 0;9.81 0;0 l;-3.27 0] 

B=[0; -0.667; 0; 0.889] 

C=[l 0] 

D=0 

%Check for controllability; 

rank_of_M=rank(ctrb (A,B) ) 
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%Enter desired characteristic equation 

chareqn=[l 12 72 192 256] 

%Calculate desired closed-loop poles 

desiredpoles=roots ( chareqn) 

%Calculate feedback gain matrix using Ackermann's formula 

K=acker ( A,B , desiredpoles ) 

The output at the command window is 

»exampl03 

1.0000 

9.8100 

1.0000 

-3.2700 

B= 



-0.6670 



0.8890 

C= 

10 

D= 


rank_of_M= 

4 
chareqn= 

1 12 72 192 256 
desiredpoles= 

-4. 0000+4. OOOOi 
-4. 0000-4. OOOOi 
-2. 0000+2. OOOOi 
-2. 0000-2. OOOOi 
K= 

-174.8258 -57.1201 -39.1437 -29.3578 

The state-variable feedback solution was implemented in SIMULINK as shown in 
Figure A 1.4. 

Inverted Pendulum, Fuzzy Logic Controller Design: The fuzzy logic controller used 
for the inverted pendulum problem has four input windows and one output window 
as shown in Figure 10.14. One version of the controller has a Mamdani-type rulebase 
consisting of 11 rules as given in equation (10.52). The MATLAB Fuzzy Inference 
System (FIS) Editor can be entered by typing at the MATLAB prompt 

» fuzzy 

This brings up the main menu screen as shown in Figure A 1.5. Double-clicking on 
the 'theta' icon brings up the membership function editor. Figure A 1.6 shows the NB 
fuzzy set being given the trapizoidal (trapmf) membership function [—1—1 —0.10]. 
Other membership functions include gaussmf (Gaussian), trimf (triangular) and 
gbellmf (generalized bell). For further information type 

» help fuzzy 

Returning to the main menu and double-clicking on the centre box entitled 
'Pendulum 11' (mamdani) will bring up the FIS rule editor, as shown in Figure 
A 1.7. Highlighted are the antecedents and the consequent of Rule 1. 
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theta 



tdot 



x' = Ax+Bu 
y = Cx+Du 



Inverted pendulum 
x 



xdot 



Scope4 



29.3 < 



Fig. A1.4 Inverted pendulum control system design using pole placement 



Scope 



* — ► 



Scopel 



f — ► 



Scope2 



f — ► 



Scope3 



theta 



tdot 



xdot 



Pendulum11 
(mamdani) 




FIS Name: 



Pendulum11 



FIS Type: 



mamdani 



And method 
Or method 
Implication 
Aggregation 
Fuzzification 














min 


▼ 




Current Variable 












max 


▼ 




Name 












min 


▼ 




Type 
Range 








max 


▼ 
















centroid 


▼ 




Help 




Close 















System "Penduluml 1": 4 inputs, 1 output, and 1 1 rules 



Fig. A1.5 Main menu of Fuzzy Inference System (FIS) editor. 



Membership function plots P lot points: 



FIS Variables 


NB 


XX 




AA 


1 


theta 




f 




XX 




0.5 


tdot 




XX 






X 






— 


XX 





xdot 




0.1 -0.08 -0.06 -0.04 -0.02 0.02 0.04 0.06 0.08 0.1 

Input variable "theta" 



Current Variable 

Name theta 

Type input 


Current Membership Function (click on MF to select) 




Name 


NB 










Type 


trapmf ▼ 












Params 


[-1 -1 -0.1 0] 




Range [-0.1 0.1] 




















Help 




Close 




Display Range j_ A Q1] 












Ready 



Fig. A1.6 FIS membership function editor. 
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2. If (theta is PB) and (tdot is Z) then (f is PB) (1 ) 

3. If (theta is PB) and (tdot is NB) then (f is Z) (1 ) 

4. If (theta is Z) and (tdot is PB) then (f is PB) (1 ) 

5. If (theta is Z) and (tdot is Z) then (f is Z) (1) 

6. If (theta is Z) and (tdot is NB) then (f is NB) (1) 

7. If (theta is NB) and (tdot is PB) then (f is Z) (1 ) 

8. If (theta is NB) and (tdot is Z) then (f is NB) (1) 

9. If (theta is NB) and (tdot is NB) then (f is NB) (1) 

10. If (tdot is PB) then (f is PB) (1) 

1 1 . If (tdot is NB) then (f is NB) (1 ) 



If 



and 



and 



and 



Then 



theta is 



tdot is 



x is 



xdot is 




NB 



PB 



NB 



PB 



™ a 




not 



not 



not 



-Connection - 
O or 
® and 



Weight 



Delete rule Add rule Change rule 



□ □ 



FIS Name: Pendulum11 



Help 



Close 



Fig. A1.7 FIS rule editor. 




force 



x' = Ax+Bu 
y = Cx+Du 



theta 



Fuzzy Logic 
Controller 



Inverted pendulum 



tdot 



xdot 



Fig. A1 .8 Simulink implementation of inverted pendulum fuzzy logic control problem. 
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When editing is complete, the controller is stored as a .fis file, in this case 
pendulumll.fis. The inverted pendulum fuzzy logic control problem can now be 
implemented in SIMULINK as shown in Figure A 1.8. The fuzzy logic icon is 
obtained by opening the fuzzy logic toolbox within the Simulink Library Browser, 
and dragging it across. Running the simulation as it stands in Figure A1.8 will bring 
up a MATLAB error because the properties of the fuzzy logic controller have not 
been defined. At the MATLAB prompt, type 

» f ismat=readf is 

This will allow you to select from a directory a suitable stored filename, i.e. 
pendulumll.fis. The system will respond with 

f ismat= 

name: 'Pendulumll' 

type: 'mamdani' 

andMethod: 'min' 

orMethod: 'max' 

def uzzMethod: 'centroid' 

impMethod: 'min' 

aggMethod: 'max' 

input: [1x4 struct] 

output: [lxl struct] 

rule: [lxll struct] 

This means that the fuzzy logic controller parameters have been placed in the work- 
space under ' f ismat ' , and that the simulation can now proceed. More details on 
the properties of the fuzzy logic controller can be found by typing 

» out=getf is (f ismat ) 
The system will respond with 



Name = Pendulumll 


Type = mamdani 


Numlnputs=4 




InLabels= 




theta 




tdot 




X 




xdot 




NumOutputs=l 




OutLabels= 

f 
NumRules 




= 11 


AndMethod 


=min 


OrMethod 


=max 


ImpMethod 


=min 


AggMethod 


=max 


Def uzzMethod 


=centroid 


Out= 




Pendulum 11 





The results of the pole placement and the 1 1 rule and 22 rule fuzzy logic controllers 
are compared in Figure 10.15. Figure 10.16 shows the 6—6 control surface, also 
generated using the FIS Editor. 
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1 neuron ^x -( )- ] n ^ ron 

input layer NX\^^ X ^^/V7 ,- 0U '.P U '^f ,. 

x purehn activation function 



10 neuron 
hidden layer 
tansig activation function 

Fig. A1.9 Demonstration neural network. 

The MATLAB Neural Network Toolbox: This Toolbox was not used in the Exam- 
ples given in Chapter 10. For details on the Toolbox, type 

» help nnet 

To demonstrate how the Toolbox is used, consider a neural network with a structure 
shown in Figure A 1.9. 

The script file neural l.m trains and runs the network. 

Filename: neurall.m 

%Feedf orward Back-propagation Neural Network 

%Network structure: l:10(tansig) :l(purelin) 

%P=Input values 

P= [012345678]; 

%T=Target values 

T=[0 0.84 0.91 0.14 -0.77 -0.96 -0.28 0.66 0.99]; 

plot(P,T, 'o') ; 

%Use Levenberg-Marquardt back-propagation training 

net=newff ( [0 8 ] , [ 10 1 ] ,{' tansig' 'purelin'}, 'trainlm' ) ; 

Yl=sim(net,P) ; 

plot(P,T,P,Yl, 'o') ; 

net.trainParam.epochs=50 ; 

net=train (net ,P ,T) ; 

Y2=sim(net,P) ; 

plot(P / T / P / Y2 / 'o') ; 

P is a vector of inputs and T a vector of target (desired) values. The command 
newf f creates the feed-forward network, defines the activation functions and the 
training method. The default is Levenberg-Marquardt back-propagation training 
since it is fast, but it does require a lot of memory. The train command trains the 
network, and in this case, the network is trained for 50 epochs. The results before and 
after training are plotted. 
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Appendix 2 
Matrix algebra 



A2.1 Definitions 

Matrix: An m x n matrix A is an array of elements with m rows and n columns, and 
is written as 



(A2.1) 





a u 


a u . 


a\ n 


A = 


a 2 \ 


a 22 • 


®2n 




_a m \ 


&m2 


Q<mn 


If m = n, A is a square matrix. 








Vector: A column vector x is 









x 2 



A row vector y is 



y = [y\ yi • • • y n ] 



Null matrix: This has all elements equal to zero. 



B 



... 
... 

... 



(A2.2) 



(A2.3) 



(A2.4) 



Diagonal matrix: This is a square matrix with all elements off the diagonal equal to 
zero. 



en 

C 22 

c 33 



(A2.5) 
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Identity matrix: This is a diagonal matrix with all diagonal elements equal to unity, 
and is normally denoted by I. 



(A2.6) 



n 





01 





i 











1 



Symmetric matrix: This is a square matrix where elements ay = a^. 

"5 8 9^ 

8 4 2 

9 2 3 



(A2.7) 



A2.2 Matrix operations 

Transpose of a matrix: The transpose of a matrix A, denoted by A T , is formed by 
interchanging its rows and columns. 



2 4 5 

3 1 9 
6 8 4_ 

"2 3 6 

4 1 8 

5 9 4 

Determinant of a matrix: Given a 2 x 2 matrix 

A 
Its determinant is 



a u a u 
an an 



detA 



a n a u 

#21 #22 



^11^22 — ^21^12 



(A2.8) 



(A2.9) 



(A2.10) 



(A2.ll) 



Minors of an Element: The minor My of element ay of detA is the determinant 
formed by removing the /th row and theyth column from detA. 



detA 



8 6 2 
4 3 1 

9 5 7 



M 



23 



8 6 

9 5 



-14 



(A2.12) 



Cof actor of an Element: The cofactor Cy of element ay of det A is defined as 

Cy = (-lf^My 
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In general, the determinant of a square matrix is given by 

n 

detA = y^afcCik (expanding along the zth row) 



k=\ 



or 



Given 



detA = S^akjCkj (expanding along theyth column) (A2.13) 



A = l 



3 


- 1 


4 5 


+ 6 


4 5 


8 9 




8 9 




3 



2 4 5 
1 3 
6 8 9 

Expanding along the first column gives 
detA = 2 

= 2(27)-l(-4) + 6(-15) 

= -32 

Singular matrix: A matrix is singular if its determinant is zero. 

Nonsingular matrix: A matrix is nonsingular if its determinant is not zero. 

Adjoint of a matrix: The adjoint of an n x n matrix is the transpose of the matrix 
when all elements have been replaced by their cofactors. 



(A2.14) 



adjA 



C\\ C\2 ... C\ n 

Ql C22 • • • C2n 



r 

x - II, 



(A2.15) 



_ C n \ C n 2 

Inverse of a matrix: An n x n matrix A has an inverse A -1 , which satisfies the 
relationship 

A ! A = AA ! = I 



The inverse of A is given by 



adjA 



"detA 
Addition and subtraction of matrices: The sum of two matrices 

A + B = C 
is given by 



(A2.16) 

(A2.17) 



a u + b u = c u 



(A2.18) 



the difference between two matrices 



A-B = C 
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is given by 



ay-by 



Multiplication of matrices: The product of two matrices 

AB = C 
is given by 



^2 aikbki 



Multiplication by a constant 



kA 



k=\ 



a n a u 

an a 2 2 

ka\\ kan 

ka2i ka22 
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(A2.19) 



(A2.20) 



(A2.21) 



Note that in general, multiplication is not commutative, i.e. AB ^ BA. 



Trace of a matrix: The trace of an n x n matrix is the sum of the diagonal elements of 
the matrix. 



tr A = a\\ + a22 



(A2.22) 



Rank of a matrix: The rank of a matrix is equal to the number of linearly independ- 
ent rows or columns. The rank can be found by determining the largest square 
submatrix that is nonsingular. 
If 



(A2.23) 



1 


2 


3" 





4 


1 


1 


2 


3 



since det A is zero, the 3 x 3 matrix is singular. Consider a submatrix 

A - \ l 2 
^sub — q 4 



(A2.24) 



The determinant of A su b is 4, hence the rank of A is the size of A su b, i.e. 2. 
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Artificial intelligence (AI) 3, 325 
Artificial neural networks (ANNs) 3, 347 
ASCII 382 
Assembler 198 
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Asymptote angles 127, 131, 137 
Asymptote intersection 126, 127, 131, 

137 
Asymptote intersection (break 

frequency) 159 
Asymptote intersection: first-order 

system 1 54 
Asymptote intersection: second-order 

system 155 
Asymptotes 142 
Asymptotic approximation: Bode 

diagrams 153 
Asymptotic construction: Bode plot 154 
Athans 3 

Augmented plant matrix P(s) 3 1 5 
Augtf 416 
Author 299 

Autonomous systems 325 
Autopilot 273 
Autoscale 384 
Auxiliary polynomial 117 
Average magnitude of sensitivity 

function 305 
Axis 390 
Axon 347 



Back emf 73 

Back-propagation 356, 362 
Back-propagation algorithm (BPA) 347, 

351,377 
Band drying oven 289 
Bandwidth 175-179, 183, 186, 188-189, 

191-192, 194-197, 200, 222 
Bandwidth (cj b ) 172 
Bang-bang control 7, 273 
Barrett 373 

Bell Telephone Laboratories 2 
Bellman 3, 272 

Best estimate of measured variable 285 
Best flatband response 175-178 
Bias 348 

Bilinear transformation 222 
Bill of materials 4 
Binary word 198 
Biological neurons 347 
Black box approach 358 
Block diagram 4 

form 63 

manipulation 67 

reduction 66 



transformation theorems 67, 68 

with interaction 68 
Blocks in cascade 207 
Bode 2 
Bode 393 
Bode diagram 151-152, 165, 

first-order system 154, 159 

lead compensator 185 

pure integrator 158 

second-order system 157, 160 

active lead network 180 
Boltzmann constant 373 
Boolean AND function 333 
Boolean OR function 333 
Bound of multiplicative uncertainty 306 
Bound of the multiplicative model 

uncertainty 311, 323 
Boundary of a system 4 
Bounded inputs 304 
Branch 416 
Breakaway points 121, 126, 127, 138, 142, 

218-20, 230 
Break-frequency 200 
Breeding of successive generations 365 
Bucy 3, 285 
Bulk modulus 77 
Burner 6 

exhaust temperature tb{t) 289 

gas supply valve angle v a (t) 289 

model 290 
Burns 290, 299, 359 



C and C++ 199 

C2d 402 

C2dm 397 

Canonical robust control problem 314 

Capacitance 21 

Capacitive element 22, 25 

Capacity requirements planning 4 

Car cruise control system 269 

Cartesian co-ordinates 226 

Cascade 65 

Cauchy's theorem 161 

Central processing unit (CPU) 198 

Centre of area method 335 

Centrifugal speed governor 1 

Chain rule 352 

Characteristic equation 2, 50, 114-116, 120, 

127-128, 131, 138, 220, 227, 230, 

240-241, 260, 262, 264 
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Characteristic equation: sampled-data 

system 215 
Chiang 3 
Chromosome 365 
Clf 383 

Clipped fuzzy output window 335-336 
Cloop 385 
Closed form 203 
Closed-loop 6 

bandwidth 224 

characteristic equation 114, 252, 265 

control system 63 

damping ratio 126 

dynamics of observed state feedback 
control system 260 

eigenvalues 249, 277, 280, 321, 323 

eigenvalues: band dryer 293 

equations 260 

frequency response 172-173, 178, 186, 
189, 225 

modulus 172 

peak magnitude M p 194 

peakM p 189,191 

poles 118,225,249 

pulse transfer function 209-210, 212, 220 

state equations 261 

system matrix (A - BK) 249 

temperature control system 107 

time-constant 83, 108 

transfer function 63, 107, 194 

transfer function matrix 315 

zeros 118 
Clustering 366 

CNC machine-tool positional control 92 
Co-active ANFIS (CANFIS) 364 
Coefficient of discharge 29, 78 
Cofactor of an element 425 
Co-factors 242 
Cognition subsystem 325 
Combined transfer function 65 
Combining blocks in cascade 67 
Combining blocks in parallel 67 
Command vector \(kT) 282-283 
Command vector \(t) 281 
Compensated modulus crossover 

frequency 190 
Compensator 133 

characteristics 133 

design 133 

design in the frequency domain 178 

gain constant 197 



Competitive learning 347 
Complementary sensitivity function 307 

multivariable system 316 

T(s) (classical control) 301 

T(s) (internal model control) 302 

T m (i(j) 309 
Complete state feedback 266 
Completing the square 53, 88 
Complex: 

dominant loci 135 

exponential form 145 

frequency approach 147 

plane 119 

quantity 148 

space 148 

variables 2 

zeros 138 
Compressibility effects 77 
Computer numerically controlled (CNC) 

machine tool 3, 8 
Cond 382 

Conditions of uncertainty 325 
Conformal mapping 161 
Conical pendulum 1 
Conjugate 147 
Consequent 330 

Consistent right-hand system of co- 
ordinates 101 
Constant: 

acceleration input 42 

amplitude harmonic forcing 193 

multiplication 38 

position input 41 

velocity 14 

velocity input 42, 107 
Constrained functional minimization 

272 
Continuity equation 31,77 
Continuous 384 

cycling method 91 

solution of the matrix Riccati 
equation 276 

system 225 

-time solution of state equation 245 

-time state transition matrix <p(t) 269 
Control: 

algorithm 198, 228 

column 7, 8 

engineering 4 

equation 254 

fins 32, 143 
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Control: {continued) 

input 4, 5 

law 140 

matrix 233 

moment 9 

of an autonomous underwater vehicles 
(AUV) 364 

signal 6, 7, 9, 10 

strategy 140 

surfaces 7, 8 

system 6, 10 

system design 10 

system designer 12 

system toolbox 408, 417 

variable (inverted pendulum) 339 

variables 291 

vector u(t) 248 

weighting matrix R 274 
Controllability 248 

matrix M 248,251,270 
Controllable 248-249 

canonical form 238, 251, 253 

canonical form method 250, 251, 253 
Controlled variable 4, 5, 12 
Controller 5-7, 10, 93 

emulation (neural network) 361 

transfer function 320 
Controlling device 10 
Conv 385 

Conventional set theory 327 
Convolution integral 38, 239, 242 
Cost function 272 
Course changing 9 
Course-keeping 9, 273 
Co variance matrix 288 

P: band dryer 299 

P(fc+l/fc+l) 322 
Craven 364 
Create new model 384 
Crisp control signal 335-336 
Crisp set 327 
Critical damping 51-52, 61, 112, 193, 254 

coefficient 5 1 
Crossover point 365 
Cross-sectional area 29-30 
Cross-track: 

error 273 

position error 299 

velocity error 299 
Ctrb 404 
Current 4, 9, 22 



D/A converter 198 

Damped natural frequency 54, 59, 62 

Damping 15-16 

coefficient 17, 19, 33, 61, 193, 267 

element 1 6 

ratio 49, 51-52, 55, 62, 100, 133, 144, 193, 
230, 258, 378 
Dashpot 16, 92 
Data: 

address register 198 

bus 199 

for Nyquist diagram 167 

fusion 325 
dc motor 266 
dc servo-motor 9, 71, 93 
Decibels 151 

Defuzzification process 335 
Degrees-of- freedom 100 
Delay in reward parameter 346 
Delimiter 327 
Delta rule 351,353-355, 357 
Demanded rudder angle 9 
Dendrites 347 
Derivative action time 90 
Design: 

in the s-plane 132 

of control systems 12 

procedure: lag compensation 190 
Desired: 

closed-loop characteristic equation 
251 

closed-loop eigenvalues 258 

closed-loop poles 231, 271 

eigenvalues 262 

heading 9, 101 

set of closed-loop poles 250 

state trajectory r(t) 280 

state vector: band dryer 293 

state vector x(kT) 282 

state vector r(0 281 

temperature 6-7 

value 4, 6, 10 

value of closed-loop eigenvalues 299 
Det(A) 381 

Determinant of a matrix 425 
Determination of: 

K on root loci 126 

points on root loci 126 

real closed-loop pole 130 
Diagonal matrix 424 
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Difference equation 202, 206, 208, 210, 212, 
228-229 

digital compensator 224 

method 205 
Differential equation 2-3, 14, 19, 21, 26, 30, 
32-34, 36, 39, 202 

with constant coefficients 1 5 
Digital: 

circuits 10 

compensator 216, 222-223 

compensator design 220 

compensator design using pole 
placement 224 

compensator types 221 

control system design 198, 210 

error signal 8 

feedback signal 8 

format 8 

PID controller 221, 222 

signal 10 
Direct comparison method 250-252, 256, 

258, 265 
Direct construction method 174 
Discrete: 

performance index 282 

quadratic performance index 276, 281 

reverse-time state tracking equation 28 1 , 
283 

solution of the matrix Riccati 
equation 276 

solution of the state equation 276 

system model: band dryer 291 
Discrete-time 200 

compensator 231 

control matrix B(T) 245 

control transition matrix B(T) 270 

response 204, 210 

solution of state equation 244 

state transition matrix A(T) 245, 269 

system 23 1 

unity feedback control system 230 
Discretized universe of discourse 331 
Discriminant 50 
Disturbance: 

attenuation 316 

attenuation factor 316 

effects 12 

input 4-5 

noise covariance matrix Q 287 

noise covariance matrix Q: band 
dryer 297 



rejection 303 

transition matrix C<x(T) 286-287 

transition matrix C&(T): band dryer 293 

variables 291 
Disturbances 9 
Dominant: 

closed-loop poles 142 

first-order response 134 
Don't care symbol '*' 370 
Drew 290 
Dreyfus 272 
Dryer: 

clay feed-rate /(0 289 

model 290 

outlet clay moisture content m/(t) 289 

outlet temperature td(t) 289 
Drying oven 34 
Dummy time variable 239 
Dynamic: 

behaviour 13-14 

characteristics 10, 12, 14 

programming 3, 272 

response 10 

system 35 



Eig(A) 381 
Eigenvalues 255 
Elastic element 1 5 
Electrical: 

networks 23 

noise 12 

system 13, 21, 25, 27 
Electrohydraulic servovalve 7 
Electromagnetic force 31 
Electrostatic equation 22, 26 
Elements of the Riccati matrix P 280 
Elevator 7-8 

control 7 
Eliminating: 

a feedback loop 67 

a forward loop 67 
Embedded microcontrollers 198 
Empirical approach 91 
Energy output 5 
Engine torque 13 
Envelope of exponential form 110 
Epoch 360 
Equating: 

imaginary parts 128,131,138 

real parts 128, 131, 138 
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Equation: 

of a circle 173-174 

of motion 18-20 
Equivalent: 

block diagram 67 

damping coefficient 21 

mass 94 

moment of inertia 21 

time constant 58-59 
Erasable programmable read only memory 

(EPROM) 198 
Error 7 

back-propagation through plant 
model 361 

coefficients 83 

detector 106 

signal 64 

-actuated system 6 
Estimate x of actual state vector x 254 
Euler-Lagrange equations 272 
Evans 2, 119 
Evolutionary process 365 
Executable machine code 198 
Exhaust pressure 76 
Experimental determination of system time 

constant using step response 46 
Exponential: 

indices 242 

matrix e At 240 
External forces 17 
Eye 382 



Factored roots 39 
Feedback 385 
Feedback: 

amplifier 2 

control system 6, 63 

gain matrix: band dryer 292 

path 6 

sensor 10 
Feedforward neural network 349 
Feel simulator 8 
Field: 

coil 33 

constant 74 

control 74 

controlled d.c. motor 33 

controlled dc servo-motor 75-76, 104 

current 33 
File 384 



Filtering effect 256 
Fin: 

positional control system 32, 143 

time constant 135 
Final: 

lead compensator 188 

state x(0 248 

value theorem 38, 82-84, 168, 212 
Firebrick walls 34 
First-order: 

differential equation 15, 23, 27, 43, 60, 
236 

element 62 

lag systems 153 

lead system 155 

linear system 15 

sampled-data system 208 

system 18 

type zero system 1 69 
Fismat 422 
Fitness function 365-366, 370, 379 

positional control system 368 
Fixed control strategy 12 
Flow: 

gain 79 

-pressure coefficient 79 

-rate 27 
Fluid: 

damper 33, 61, 104 

systems 27 
Flyball governor 1 
Flywheel 19 
Foh 397 

Forms of uncertainty 299 
Forward: 

propagation 356 

speed 13, 28 

speed loss 273 

velocity 4 
Forward-path 6 

transfer function 63, 65, 107 
Fourier 2 
Fourier's Law 25 

Free-body diagram 17-18, 20, 28, 52 
Frequency: 

of maximum phase advance 196 

of transient oscillation 56 
Frequency domain 2, 145 

analysis 145, 175 

performance specifications 172 

specification 179, 192 
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Frequency response 2 

characteristics: lag compensator 190 

diagram 1 50 

diagrams 1 5 1 
Frictional moment 19 
Full-order: 

observer 258 

state observer 254-255, 260, 271 
Fully connected multilayer network 349 
Function of time 35 
Fuzzification process 331 
Fuzzy 418 
Fuzzy: 

conditional statement 332 

inference 332 

input window 332 

logic 3, 326 

max operation 333 

max-min inference 340 

min operation 333 

output window 334 

relations 330 

rulebase 332, 336, 374 
Fuzzy logic: 

control (FLC) 331 

controller 3, 373 

toolbox 341, 417 
Fuzzy set operations: 

complement 328, 329 

equality 328 

intersection 328, 329 

union 328, 329 
Fuzzy set theory 326-327 
Fuzzy sets 326 



Gain: 

margin (GM) 165-166, 175-178, 184, 
188-189, 196 

reduction 184 

reduction factor 177 

scheduling controller 299-300 
Gas: 

burner 34, 97 

fire 5 

solenoid valve 6, 97 

solenoid valve and burner 10 
Gaussian noise sequence \(k + 1) 286-287 
Gearbox 92-93 
General: 

form of a digital control system 220 



performance index 273 

second-order transfer function 40 
Generalized: 

control problem 81 

second-order system response to a unit 
step input 52 

second-order transfer function 
122 

transfer function 238 
Generic elements 10 
Genetic: 

algorithm (GA) 365 

information 365 

material 365 

structure 365 
Getfis 422 
Global: 

minimum energy state 373 

optimum 365 
Goldberg 365 
Governor 2 

Gradient-descent optimization 351 
Graphical 

addition 151 

user interface (GUI) 384 
Grid 383 
Grimble 3 
Grossberg adaptive resonance theory 

(ART) 350 
Gyro-compass 9, 102 



He. 



norm 3, 310 

-control problem 308 

-optimal control 306 
H 2 

-norm 310 

-optimal control problem 305 
Hall chart 174 
Hamiltonian function 272 
Hamilton-Jacobi 

equation 275 

partial differential equation 272 
Harmonic 

input 145 

response diagram 146-148 
Head 29-30 
Heading 4 

error 273, 299 

-rate error 299 
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Heat 26 

flow 25 

loss 7 

sink 26-27 

source 26 
Heave 4 
Hebb 3, 347 
Hebbian learning 347 
Help 382 
Heuristics 365 
Hidden layer 349 
High: 

frequency noise 179 

level language 198 

-frequency (HF) asymptote: first-order 
system 153 

-speed jet 7 
Hinfopt 415 
Holland 365 

Hospital operating theatres 7 
Hull 9 

dynamics 101 

transfer function 102 
Human vagueness 3 
Hunting 2 
Hurwitz 2, 112 

determinants 113 
Hydraulic: 

actuators 75 

cylinder 8 

damping ratio 8 1 

gain 8 1 

natural frequency 81 

servomechanism 8, 106 
Hydrodynamic resistance 28 



Ideal sampling 201 
Identity matrix 425 
Imaginary axis: 

crossover 126, 128, 131, 138 

crossover point 142 
Imaginary part 148 
Implementation of reduced-order state 

observer 263 
Impulse 383 
Impulse: 

function 41 

response of first-order system 44 
Inductance 21 
Inductive element 22 



Industrial standards rooms 7 

Infinite power series method 204 

Infinity norm 307 

Inflow 29-30 

Information technology (IT) 325 

Infrared absorption analyser 289 

Initial: 

conditions 39 

state x(f ) 248 

value theorem 38 
Input: 

function 36 

fuzzy set membership values 
332 

layer 349 

variable 234 

vector 233 

weight 304 
Inputs 4 
Insertion loss 195 
Instability 2 
Instantaneous change 14 
Instruction register 198 
Integral: 

action time 84 

control action 170 

squared error (ISE) 305 

wind-up 9 1 
Intelligent 

behaviour 325 

control system 3, 325 
Internal model control (IMC) 301, 

361 
International Federation of Automatic 

Control (IFAC) 3 
Inv(A) 381 
Inverse: 

Laplace transforms 242 

model 360 

of a matrix 426 

square law 300 

transform 38, 54, 59, 243 

z-transformation 204 
Inverted: 

pendulum 347 

pendulum system 337 



James Watt 1 

Jang 362 

Johnson 325, 337, 340 
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Jury 215 

stability test 215 

test 218, 230 
Jury's array 216-217 



Kalman 3, 248, 276, 285 
filter 3, 285, 287-288 
filter design: band dryer 295 
gain 286 

gain matrix K 286-288 
gain matrix K: band dryer 299 
gain matrix K(k + 1) 322 

Kang 362 

Kinematic relationships 21 

Knowledge-based systems 326 

Kohonen 3, 347 

self-organizing map (KSOM) 350 



Lag compensator 191 
Laplace 2 

and z-transforms 204 

transform 36, 39, 79, 94, 102, 202 

transform of a time derivative 37 

transform pairs 37-38, 88 

transforms 98, 147, 239-240 
Laser guided missile 32, 143, 182, 222 
Lead: 

compensator 222 

compensator design 183, 186 
Lead-lag compensation 92 
Lead-screw 9, 92-93 
Leakage: 

coefficient 78 

flow-rate 77 
Learning rate 353, 360, 377 
Levenberg-Marquardt back- 
propagation training 423 
Line of constant damping ratio 129, 132 
Linear: 

bearings 3 1 

differential equation 15, 27-28 

displacement transducer 92 

lumped parameter elements 1 5 

phase-log frequency plot 151 

relationship 14, 29 

systems 2, 15 
Linear quadratic: 

Gaussian (LQG) control scheme 288, 
322 



//2-optimal control 305 

regulator (LQR) 274, 288 

tracking problem 280 
Linearity 37 

Linearization of nonlinear functions 27 
Linearize 27 

hydrodynamic resistance 28 
Linearized: 

equation 31 

outflow 86 

relationship 30 

spool-valve analysis 78 

valve resistance 29 
Linearly independent 249 
Linear-quadratic-Gaussian (LQG) 

control 3 
Lines of constant: 

settling time 214 

transient frequency 214 
Linguistic label 332 
Liquid-level process control system 85 
Load: 

damping coefficient 106 

flow-rate 76, 79 

moment of inertia 106 

on hydraulic actuator 80 

pressure 76 
Local: 

minima 354 

optima 365 
Log modulus plot 153 
Log modus-log frequency plot 151 
Logarithmic decrement 56 
Logspace 393 
Low frequency (LF) asymptote 1 59 

first-order system 153 
Low level language 198 
Low-cost applications 7 
Low-pass filter 179 
LQ control 3 
Lqe 410 
Lqed 411 
Lqr 408 
Lqrd 410 

Luenberger observer 254 
Lyapunov 2 



M and N: 
circles 174 
contours 175 
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Machine: 

intelligence 325 

table 8, 9, 93 
Magnetic compass 9 
Magnitude criterion 124, 129, 132 
Major loop 64 
Mamdani 3, 332 

-type rule 332 

-type rulebase (inverted pendulum) 340 
Mapping: 

closed-loop poles from s to z-plane 226 

from s to z-plane 213 

from s to z-plane 214 
Margin 394 

Marginal stability 91, 126, 218-219, 312 
Margins of stability 164 
Mariner Hull 103, 358 
Mass 13,15,17,26 
Master production schedule 3 
Material requirements planning (MRP) 

system 3-4 
Mathematical model 4, 13-15, 21, 25, 27, 

35-36, 55, 254 
MATLAB 109, 133, 161, 341 

command window 

control system toolbox 382 

editor/debugger 383 

fuzzy inference system (FIS) editor 344 

robust control toolbox 320 

toolboxes 380 
Matrix 424 

of multiplicative plant uncertainty 3 1 6 

Riccati equation 272, 276, 280, 323 

vector difference equation 245-246 
Matrix operations : 380 

A + B 381 

A*B 381 

A\B 381 

A/B 381 

A' 382 
Max 396 
Maximum: 

closed-loop peak modulus M p 195 

closed-loop peak M v 196-197 

magnitude of weighted sensitivity function 
infinity norm 306 

phase advance m 187, 195 

principle 3, 272 
Max-min: 

fuzzy inference 336 

fuzzy reasoning 333 



inference 337 

inference process 333, 335 
Maxwell 2 
McCulloch 347 
Measured: 

elevator angle 7 

open-loop frequency response data 164 

value 6, 10 
Measurement: 

matrix C(7) 287 

noise covariance matrix R 287 

noise covariance matrix R: band 
dryer 295 

vector z(k + \)T 287 
Mechanical: 

levers 10 

system 13, 15-17 
Membership function /i 327 
Microcomputers 10 
Microcontroller 198 
Microprocessor control 198 
Mid-frequency (MF) asymptote 155 
Minimum energy control problem 273 
Minimum-time control problem 273 
Minor control loop 9, 64 
Minors 242 

Minors of an element 425 
Mixed-sensitivity cost function 317 
Mksys 416 
Model: 

of a single artificial neuron 348 

of band dryer system 290 
Modulus 145, 147-148, 150-152 

and phase for a first-order system 149 

and phase for a second-order system 150 

attenuation 190-191 

crossover frequency 182-184, 186-187, 
191 
Moisture models 290 
Moment of inertia 17, 19, 33, 61, 104, 143, 

267 
Momentum (learning with) 354, 360 
Momentum coefficient 355 
Morse 359 
Motor shaft 20 
Motor vehicle 13-14 
Moving a: 

summing point ahead of a block 67-68 

summing point beyond a block 67 

take-off point ahead of a block 67 

take-off point beyond a block 67 
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/i-synthesis theory 3 

Multi-layer perceptron (MLP) 347, 351 

Multiple: 

input, multiple output (MIMO) 
systems 232 

loop systems 64 
Multiplication: 

by a constant 427 

of matrices 427 
Multiplicative uncertainty 303, 306 
Multi variable: 

Hqq robust control 316 

H.2 robust control 316 

loop shaping 317 

robust control 314 

systems 232, 245, 248 
Mutation rate 365 



Networks 23 
Neural network 

state observer 358 

toolbox 417 
Neuro fuzzy control 361 
Newff 423 

Newton's second law of motion 17, 29, 52 
Ngrid 395 
Nichols 395 

Nichols chart 175-178, 196-197 
Nichols 2 
Nichols chart: 

lead compensator 184, 188 

uncompensated laser guided missile 183 
Nominal plant model G m (s) 300 
Non-linear 27, 232 

function 27 
Non-singular 248-249, 258 

matrix 426 
Non-zero determinant 248-249 
Normal cross sectional area 25 
Normalized system inputs 304 
Null matrix 424 
Number of: 

clockwise encirclements 162 

distinct root loci 125, 218 

pure integrations in the open-loop transfer 
function 168 

roots with positive real parts 141 
Nyquist 393 
Nyquist 2, 162 

contour 163 



diagram 164-168, 170, 174, 194 

frequency 200 

stability criterion 162, 164, 306 



Observability 248 

matrix N 248-249, 257, 270 
Observable 248 

canonical form 257, 259 

canonical form method 257, 259 
Observed state variables 260 
Observer: 

design 256 

gain matrix K e 255, 257, 271 

transient response 256 
Obsv 404 

Offspring chromosomes 365 
Ohm's Law 22, 26 
On-governors 2 
On-off control 7 
Onset of instability 142 
Open-loop 

characteristic equation 265 

control system 5 

eigenvalues 249, 258 

frequency response data 195 

frequency response locus 176 

frequency response test 194 

gain constant 83, 115, 119, 124, 142 

poles 119-120, 127, 130, 219, 249 

pulse transfer function 210, 212, 224, 
229-231 

reduced order characteristic equation 
262 

time constant 108 

transfer function 63-64, 115, 166, 191, 
194, 222 

zeros 119-120, 127, 130, 144, 219 
Operating point 27 
Operational amplifier 179 
Optical pattern recognition 347 
Optimal: 

control law 3,272,275,281 

control law: band dryer 292 

control policy 272 

control problem 272 

control system 272 

feedback matrix K 321 

filter 3 

minimum variance filter 285 

trajectory x(t) 272 
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Optimum: 

design 3 

policy evaluation 326 
Ord2 384 
Orifice theory 78 
Oscillation 7 

Oscillatory second-order response 134 
Other applications of genetic algorithms: 

optimal control 372 

self-organizing fuzzy logic control 372 
Outflow 29-30 
Output: 

equation 234-235, 237-239 

equation (inverted pendulum) 339 

equation: band dryer 291 

error (y — y) 254 

layer 349 

shaft 20 

y(0 248 
Outputs 4 
Overall: 

closed-loop transfer function 64, 66, 68 
95 

differential equation 31 
Overdamped 61 
Overdamping 112 
Overshoot 57, 62 133, 137, 193 



Parabolic: 

fitness function 378 

function 42 
Parallel 385 
Parametric relationship 285 
Parent chromosomes 365 
Partial fraction 39, 47, 53, 88 

expansion 211, 242 
Passive 

electrical network 34, 60 

lead compensation 179 

phase lag compensator 189 
PD 133, 179 

cascade compensation 179 

compensator 263 

control 92 

controller 331 
Peak: 

closed-loop modulus M p 183 

frequency (cj p ) 172 
Peak modulus (M p ) 172, 175-176, 179, 1£ 
188 



Percentage overshoot 104, 141, 176, 

193 
Percentage overshoot of first peak 55 
Perception subsystem 325 
Perceptron 347 

Perfect set-point tracking 301-302 
Performance: 

criterion 3, 272 

index 272-273, 321, 351, 354 

index (PI) table 344, 346 

specification 10, 137 
Periodic time 96 
Phase 152 

advance 186 

advance m 182 

angle 147-150 

lag compensation 189 

lead compensation 179 

lead compensation network 195 

lead compensator 284 

margin (PM) 165-166, 175-178, 182-184, 
187-190, 194-196 

relationship 145 

-plane 232 
Physical: 

characteristics 13 

laws 10 

system 13-14 
PI 133, 170 

control 85 

control law 84 
Picton 325, 337, 340 
PID 97, 133, 170, 179 

control 138 

control action 89 

controller 108, 289 

controllers for closed-loop systems 
178 
PIDD control 140 
Piece-wise constant function 270 
Pilot 8 
Piston 8 
Pitch 4 

moment of inertia 32 
Pitts 347 
Plant 4-6, 10 

state transition equation 282 
Plot 384 

Pneumatic elements 10 
Polar co-ordinates 148 

plot 147, 150-151 
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Pole: 

angles 123 

locations: s and z-planes 215 

vector magnitudes 124 
Pole/zero cancellation 134 
Pole-zero format 143 
Poly(A) 381 
Pontryagin 3, 272 
Population of chromosomes 365 
Position error coefficient 168 
Positional: 

feedback 106 

servomechanism 268 
Positive feedback 70 
Potentiometer 6 
Power: 

amplifier 93 

series method 206 
Predictive self-organizing fuzzy logic control 

(PSOFLC) 364 
Pressure 27 

difference 8 

-flow-rate characteristics for a 
spool-valve 80 
Price 359 

Primary feedback signal 64 
Principle of optimality 272 
Principle of Superposition 69, 71 
Printsys 383 
Probability 

P of accepting a solution 373 

of selection 365 

theory 326 
Process: 

air 289 

plant 191 

reaction curve 99 

reaction method 90, 108 
Program counter 198 
Programmable read only memory 

(PROM) 198 
Propeller 28, 60 

angular velocity 28 
Proper 387 
Proportional: 

control 7, 82, 137, 142 

control of a first-order plant 82 

controller 133 

controller gain 116 

gain constant 82 

plus derivative (PD) control 92 



plus integral (PI) control 84 
plus integral plus derivative (PID) 
control 89 
Pulse transfer function 206-207, 220 
Pure integrator 138, 158, 170 
asymptote 170 



Quadratic performance index 274-275, 
291 



Ramp 384 

function 36, 42 

response of first-order system 47 
Random 

access memory (RAM) 198 

number generator 367 
Rank 248-249 
Rank 382 
Rank of a matrix 427 
Ratio of successive peaks 99, 109 
RC network 2 
RCL network 235 
Read only memory (ROM) 198 
Readfis 422 
Real: 

part 148 

shift theorem 38 

-time computational complexity 331 
Rearranging summing points 67 
Recent approaches 12 
Rechenburg 365 
Recommended compensator 135 
Rectangular plot 150,175 
Recursive: 

discrete-time simulation 245 

steps 246 
Reduced: 

block diagram 69 

matrix Riccati equation 276, 321 

observer system 266 

Riccati equation 278 

second-order state observer 264 

-order observer gain matrix K e 262 

-order state observer 254, 262, 266, 271 
Reduction gearbox 19 
Regeneration Theory 2 
Regulator 254 

control problem 273 

regulator problem 273 
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Relationship between 

cj) m and the spacing of 1/Ti and I/T2 182 

frequency response and time response: 
closed-loop systems 191 

open-loop and closed-loop frequency 
response 172 
Relative modulus 156 
Relocfind 390 
Removing a block from a 

feedback loop 67 

forward path 67 
Repeated roots 39 
Resistance 13, 21 

thermometer 6, 58 
Resistive element 22, 25 
Resolution 10, 198 
Reverse-time: 

recursive process 277 

state tracking equations 280 
Riccati matrix: 

band dryer 292 

P 277, 279, 288 

P(kT) 282 
Richter 358, 364 
Rise time 57, 104, 141, 176 
Rlocus 389 
Robust: 

control 3 

control problem 299 

control toolbox 408 

design 3 

multivariable control system design 316 

performance 300, 308-309, 312-313 

stability 300, 306-307, 311-313, 324 
Roll 4 

dynamics 137 
Room temperature control system 6 
Root locus: 

analysis: z-plane 218 

asymptotes 125 

construction rules 125 

construction rules: z-plane 218 

locations on real axis 126, 218 

method 119 

diagram 119 
Roots 381 
Roots: 

of characteristic equation 2, 49, 51, 
112, 118, 120-122, 126, 163,218, 
241-242 

with positive real parts 1 14 



Rosenblatt 3, 347 

Rotation about yaw axis 101 

Rotational: 

damper 16 

spring 1 6 

1 system 17 
Roulette wheel selection 365 
Routh 2, 112 

stability criterion 166-167 
Routh's array 113, 116, 128, 167 

special cases: a zero in the first 
column 117 

special cases: all elements in a row are 
zero 117 
Routh-Hurwitz stability criterion 113, 126, 

141,215 
Rudder 9-10 

activity 273 

angle 101 

angle sensor 9 
Rule-of-thumb 58, 91, 200 
Rumelhart 347 
Rzevski 3 



S domain 36 

algebraic equations 36 
Safanov 3 

Sampled-data system 204 
Sampling: 

frequency (cj s ) 200, 214, 222, 
224 

period T 198 

timer 201,225 
Satellite control 273 
Save as 384 
Schema 370 
Schemata 370 
Scope 384 
Script files 382-383 
Second-order: 

complex roots 39 

differential equation 15, 24-25 

element 62 

linear system 15 

real roots 39 

system 18, 58, 170, 280 

system closed-loop frequency 
response 172 

transfer functions 61 

type one system 169 
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Selection of: 

parents for mating 367 

performance index 273 
Self-organizing fuzzy logic control 

(SOFLC) 344 
Semilogx 393 
Sensitivity function 

multivariable system 315 

*S(s) (classical control) 301 

*S(s) (internal model control) 302 

S m (&) 308 
Sensor 5-6 

array 325 
Series 385 
Servomechanism 7, 107 
Servomotor 9 
Set heading 9 
Set of: 

differential equations 272 

first-order differential equations 233, 235 
Set-point tracking 303 
Settling time 57, 96, 104, 133, 137, 141, 176, 

191, 193 
Several inputs acting simultaneously 69 
Sgrid 390 
Shaft encoder 8-9 
Shannon's sampling theorem 200 
Ship 28, 60 

autopilot 100 

autopilot control system 9, 102 

roll damping ratio 137 

roll natural frequency 135 

roll stabilization system 135, 270 

steady-state gain 137 
Sigma 416 
Sigmoid: 

activation function 354 

function 352 
Signal: 

processing 325 

take-off point 64 
Simplified Nyquist stability criterion 

164 
Simulated annealing 373 
Simulation 384 
SIMULINK 341, 380, 384 

library browser 384 
Simultaneous equations 59 
Single input, single output (SISO) 

systems 232 
Single neuron summation 354 



Single-layer fully-connected recurrent 

network 350 
Singular 249 

matrix 426 

value loop shaping 315 

values of a complex matrix 3 1 5 
Sinks 384 
Slope: 

-12dB per octave (-40 dB per 
decade) 155 

— 6dB per octave (— 20 dB per 
decade) 153, 158 
Small: 

gain infinity-norm control problem 
316 

perturbation theory 28 

perturbations 27, 79 

perturbations of spool valve and 
actuator 75 
Smith 347 
Solenoid valve 31 
Solution: 

of the state vector differential 
equation 239 

space 369 
Sources 384 
Specific: 

heat at constant pressure 26 

inputs 304 
Specification 96 
Speed: 

control system 104 

of convergence 370 
Spool-valve: 

controlled linear actuator 75-76 

movement 7 
Spring stiffness 16 
Spring-mass-damper system 17-18, 51, 193, 

234, 241-242, 245 
Square 390 
ss_g 416 
Ss2tf 402 
Stability 2 

criteria 2 

in the frequency domain 161 

in the z-plane 213 

of a closed-loop system 1 14 

on the Bode diagram 170-171 
Stabilize 9 

Stable and unstable time responses 1 1 1 
Stable systems 110 
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Standard: 

components 39 

form of transfer function for a first-order 
system 44 

forms of transfer functions for a second- 
order system 49 

methodology 12 
Start 384 

Starting point 125, 218 
State equation 235-239, 241, 252, 233 

(inverted pendulum) 339 
State equations: 

band dryer 291 

from transfer functions 238 
State feedback: 

gain matrix 249, 251 

gain matrix K(kT) 282 

matrix 250 

matrix (inverted pendulum) 340 

matrix K 277, 279 
State: 

estimation 284 

observer 254, 261 

of a system 232-233 

trajectory 242-244 
State variable: 

step response 244 

time response 243 
State variables 232-236, 238, 242, 244, 254, 
291 

inverted pendulum 339 
State vector 233 

differential equation 233, 240 

x(kT) 282 
State weighting matrix Q 274 
State-space 232 

approach 232 

formulation 3 

representation of controller 320 
State-transition matrix </>(t) 240 
Static characteristics 10 
Steady-state: 

error 36,48, 62,81, 108, 132 

error coefficients 168 

gain 52 

gain constant 44, 49, 62 

period 36 

response 35 

terms 110 
Steam mass flow-rate 1 
Steering gear 9-10, 101 



Step 383 
Step: 

function 41 

input function 62 
Step response 137, 220 

analysis 55 

function 55 

of first-order system 45 

performance specification 57 
Stiffness 15, 33, 61 
Structured model uncertainty 303 
Subplot 397 
Sugeno 3, 362 
Summation of 

log modulus 153 

phase 153 

system elements 152 
Summed squared error function 351 
Summing 

point 6 

point symbol 64 
Supervised 

learning 350 

learning in neural networks 326 
Supply pressure 76 
Survival of the fittest 365 
Sutton 3 

Symmetric matrix 425 
Symmetry of root loci 125, 218 
Synapses 347 
Synaptic reaction 347 
System 4 

covariance matrix P 286 

dynamics 15, 35 

frequency domain performance 189 

inputs 236 

matrix 233 

outputs 236 

performance 141 

response 4, 36 
System type: 

and steady-state errors 168 

classification 83, 85, 168-169 
Systems with multiple inputs 69 



Tabu search 373 
Tachogenerator 9, 95, 104 
Takagi 362 
Temperature 5 
control 7 
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control system 97 

differential 25 

rise 26 
Term: 

(k/k) 286 

(fc+l/fc) 286 

(fc+l/fc+1) 286 
Terminal control problem 272 
Termination point 125, 218 
Tf2ss 402 
Thermal: 

capacitance 26, 34, 97, 108 

conductivity 25 

dynamics of room 97 

resistance 26, 34, 108 

resistance of walls 98 

systems 25 
Thermocouple 6 
Thermometer 98, 108 
Thermostatic control 7 
Thickness 25 
Third-order: 

differential equation 15 

linear system 15 

transient response 59 

type two system 169 
Three-term control action 89 
Time constant 44, 48, 59, 60, 62 
Time domain 35, 36 

analysis 35 

differential equations 36 

performance specifications 172 
Time invariant 232 
Time response 35-36, 59, 60, 62, 191 

of burner temperature: band dryer 
295 

of gas- valve angle: band dryer 294 

of higher-order systems 58 
Time-variant 12, 232 
Tolerance band 193 
Tong 3 

Torsional spring 33, 61 
Total fitness of: 

offsprings 367 

population 367 
Total response 36 
Trace of a matrix 427 
Tracking 

control problem 273 

vector s(t) 281 
Train 423 



Training 

data 358 

file 359 
Transfer fen 384 
Transfer function 39-40, 60, 62 

approach 41, 63 
Transformation matrix T 250 
Transient: 

analysis of discrete systems 213 

errors 36, 81 

period 36, 58 

response 35, 242 

response of a second-order system 50 

terms 110 
Transition matrix 0(s) 247 
Translational: 

damper 1 6 

spring 1 5 

system 17 
Transportation lag 90 
Transpose of a matrix 425 
Trial point 144 
TSS_ 416 

Turbulent flow conditions 27 
Tustin 397 
Tustin's rule 222, 223 
Two degree-of-freedom IMC system 302 
Two-mass system 237 
Two-port state-space representation 314 
Type number 168 



Ultimate: 

gain 9 1 

period 91 
Undamped natural frequency 49, 52, 62, 

193, 258 
Underdamped 61, 112 

second-order system 55 
Unit circle 214, 218 

crossover 218-219, 230 
Unit impulse 41 

function 201 
Unit parabolic function 42 
Unit ramp 48 

function 42, 208-247 
Unit step: 

function 37, 41 

input 52, 62 

response 54, 60-61 

response function 58 
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Unity feedback: 

computer control system 230 
continuous control system 230 
control system 196 
Unity gain second-order system 62 
Universe of discourse U 327, 332 



Walking beam feedback linkage 106 

Wall 26 

Watt governor 1 

Waves 4 , 9 

Weighted 

mixed- sensitivity approach 317 



sensitivity function 310, 312 

summer 348 
Weights and biases 357-358, 376-377 
Werbos 347 
Wheel traction force 13 
While 396 



Unstable systems 110 


Who 386 


Unstructured model uncertainty 303 


Whos 386 


Unsupervised 


Widrow 347 


learning 350 


Widrow-Hoff 3 


learning in neural networks 326 


Wiener 3, 284 




Wind 4, 9 


Valve 58 




flow area 29 


Xlabel 393 


Variance of the weighted mean P 285 




Variational calculus 272 




Vector 424 


Yaw hydrodynamics coefficients 


of measurements z(k + 1 ) T 286 


101 


Vehicle 14 




model 14 




Velocity 1 6 


Zadeh 3 


error coefficient 169 


Zero: 


feedback 92, 106 


angles 123 


Vessel 9 


determinant 249 


Voltage 22 


modulus crossover 183 


Volume of hydraulic fluid 76 


steady-state error 137 


Volumetric 


vector magnitudes 124 


flow-rate 29 


-order hold 201,202 


strain 77 


Zgrid 399 


stress 77 


Ziegler-Nichols 99, 108 



methods 90 
Zoh 397 
Z-plane 217, 220 

characteristic equation 226 
Z-transform 202 

theorems: initial value theorem, final value 
theorem 204 

theorems: linearity 203 



